00000001:02000400:2.0F:1789601186.296866:0:2972:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1789601207.464643:0:3194:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1789601210.268902:0:3237:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 768 MB/s 00000001:01000000:2.0:1789601210.519589:0:3237:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 915 MB/s 00000001:01000000:2.0:1789601210.769111:0:3237:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5935 MB/s 00000020:02000000:0.0:1789601211.797350:0:3286:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_ga3f6967 00000400:02000000:3.0F:1789601212.755983:0:3301:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.130@tcp [8/256/0/180] 00008000:02000000:1.0:1789601216.296822:0:3450:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789601269.867697:0:5252:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789601279.931927:0:5818:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789601279.931932:0:5818:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789601279.932050:0:5818:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000bbd5ca51 00000080:02000400:3.0:1789601279.932060:0:5818:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789601279.936307:0:5818:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789601279.936319:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789601279.936426:0:5818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000002b7b9cde) 00000020:00000080:2.0:1789601279.936442:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789601279.962204:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789601279.963213:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789601279.989395:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1789601279.989575:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789601279.989599:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1789601279.989779:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789601279.989811:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1789601279.990360:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789601279.990368:0:5818:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789601279.990378:0:5818:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3d6e402158abc00 00000020:01000004:0.0:1789601279.990386:0:5818:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1789601279.990390:0:5818:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789601279.990394:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bbd5ca51 from MGS 00000020:01000004:0.0:1789601279.990399:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789601279.990547:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000003b5eec9e) 00000020:00000080:0.0:1789601279.990559:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789601279.990776:0:5818:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bbd5ca51 from MGS, refs=2 00080000:01000000:0.0:1789601279.990782:0:5818:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789601279.990788:0:5818:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3d6e402158abc0e 00000100:00100000:0.0:1789601279.990919:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789601279.991055:0:5818:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789601279.991061:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789601279.992018:0:5818:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789601279.992026:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789601279.996039:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789601279.996621:0:5818:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789601279.996630:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789601279.997583:0:5818:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789601279.997592:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789601279.998122:0:5818:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789601279.998129:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789601279.999185:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601279.999189:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601279.999191:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601279.999787:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601279.999790:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601279.999792:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601280.000370:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789601280.008331:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789601280.250099:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2855 MB/s 00000001:01000000:1.0:1789601280.499982:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3863 MB/s 00000001:01000000:3.0:1789601280.750498:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 879 MB/s 00000001:01000000:1.0:1789601280.999992:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1199 MB/s 00080000:10000000:1.0:1789601281.005657:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1789601281.016525:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789601281.016540:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789601281.016543:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789601281.021895:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789601281.022659:0:5818:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789601281.022724:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789601281.023017:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789601281.023052:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789601281.023391:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789601281.023542:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789601281.023547:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:3.0:1789601281.035646:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601281.035708:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789601281.035719:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789601281.036330:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789601281.036337:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789601281.038488:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789601281.038507:0:5818:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.130@tcp' 00000020:01000004:1.0:1789601281.038509:0:5818:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789601281.038550:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.130@tcp (typ=mgc) 00000020:00000080:1.0:1789601281.038568:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.130@tcp (000000007ae5d333) 00000020:00000080:1.0:1789601281.038590:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789601281.038719:0:5818:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000272f6572@MGC192.168.201.130@tcp: add connection 192.168.201.130@tcp at head 00010000:00010000:1.0:1789601281.038915:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.130@tcp-0 is initialized 00000040:01000000:1.0:1789601281.038920:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789601281.039228:0:5833:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1789601281.044673:0:5834:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789601281.044723:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.130@tcp (uuid 435644e3-9e9f-44ed-9cfe-21987eda72e5) 00000020:00000080:3.0:1789601281.044744:0:5818:0:(genops.c:1384:class_connect()) connect: client 435644e3-9e9f-44ed-9cfe-21987eda72e5, cookie 0xf3d6e402158abc1c 00000100:00080000:3.0:1789601281.044756:0:5818:0:(import.c:545:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789601281.044767:0:5818:0:(import.c:666:import_select_connection()) MGC192.168.201.130@tcp: import 00000000272f6572 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1789601281.044821:0:5818:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000db4f0e50 x1876532880474240/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789601281.044907:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000db4f0e50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:435644e3-9e9f-44ed-9cfe-21987eda72e5:3316:1876532880474240:0@lo:250: 00000100:00100000:3.0:1789601281.044992:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789601281.045055:0:5818:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 435644e3-9e9f-44ed-9cfe-21987eda72e5->MGS 00000020:01000004:3.0:1789601281.045071:0:5818:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789601281.045089:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789601281.045111:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000007a5b20f8) 00000020:00000080:3.0:1789601281.045122:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789601281.046593:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880474240 00000100:00100000:0.0:1789601281.046608:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880474240 00000100:00100000:0.0:1789601281.048363:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601281.048374:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002835a563 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3316:x1876532880474240:12345-0@lo:250: 00010000:00080000:0.0:1789601281.048402:0:5830:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 435644e3-9e9f-44ed-9cfe-21987eda72e5@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:0.0:1789601281.048431:0:5830:0:(genops.c:1384:class_connect()) connect: client 435644e3-9e9f-44ed-9cfe-21987eda72e5, cookie 0xf3d6e402158abc2a 00000100:00080000:0.0:1789601281.048572:0:5830:0:(import.c:65:import_set_state_nolock()) 00000000162b5242 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601281.048690:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002835a563 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+5:3316:x1876532880474240:12345-0@lo:250: Request processed in 316us (3697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601281.048699:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601281.048770:0:3316:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789601281.048781:0:3316:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.130@tcp: connect to target with instance 0 00000100:00080000:0.0:1789601281.048789:0:3316:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789601281.048793:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789601281.048796:0:3316:0:(import.c:65:import_set_state_nolock()) 00000000272f6572 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789601281.048799:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789601281.048803:0:3316:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789601281.048807:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000db4f0e50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:435644e3-9e9f-44ed-9cfe-21987eda72e5:3316:1876532880474240:0@lo:250: 00000100:00100000:3.0:1789601281.058710:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789601281.058907:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789601281.058914:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789601281.059914:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789601281.059921:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789601281.060518:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789601281.060524:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789601281.061178:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789601281.061316:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789601281.061320:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789601281.062210:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789601281.062216:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789601281.095657:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789601281.096102:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789601281.096109:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789601281.097250:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789601281.097261:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789601281.098056:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789601281.098254:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789601281.098260:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789601281.098764:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789601281.098770:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789601281.099298:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789601281.099464:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789601281.099470:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789601281.100099:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789601281.100111:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789601281.100734:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789601281.101020:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789601281.101034:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789601281.102496:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789601281.102508:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789601281.125394:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789601281.125729:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789601281.125746:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789601281.127469:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789601281.127481:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789601281.129417:0:5818:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789601281.129430:0:5818:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789601281.130344:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789601281.130367:0:5818:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789601281.130372:0:5818:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789601281.130491:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789601281.130523:0:5818:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.130@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789601281.130528:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789601281.130530:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789601281.130531:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789601281.130532:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789601281.130533:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789601281.130534:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789601281.130535:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789601281.130537:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789601281.130538:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789601281.130539:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789601281.130612:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789601281.130614:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789601281.130616:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789601281.130618:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789601281.130620:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789601281.130621:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789601281.130621:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789601281.130622:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789601281.130624:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789601281.130625:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789601281.130626:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789601281.130627:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789601281.130627:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789601281.130628:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789601281.130629:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789601281.130722:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789601281.130738:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d86f9cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880474368:0@lo:253: 00000100:00100000:3.0:1789601281.130954:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601281.131019:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e33d1189 going to sleep for 11 seconds 00000100:00100000:2.0:1789601281.131092:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880474368 00000100:00100000:2.0:1789601281.131100:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880474368 00000100:00100000:2.0:1789601281.131161:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789601281.131167:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c7dab27b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+5:5818:x1876532880474368:12345-0@lo:253: 20000000:01000000:2.0:1789601281.131207:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789601281.131209:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789601281.131440:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789601281.131477:0:5832:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789601281.131803:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789601281.132625:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789601281.132974:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789601281.132977:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789601281.132981:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789601281.132983:0:5832:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789601281.132991:0:5832:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789601281.133132:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789601281.133283:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789601281.133294:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789601281.133338:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789601281.133383:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789601281.133416:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789601281.133467:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789601281.133472:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789601281.133495:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789601281.133499:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789601281.133514:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789601281.133517:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789601281.133531:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789601281.133621:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789601281.133712:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789601281.133717:0:5832:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789601281.133729:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789601281.134152:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789601281.134162:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789601281.134198:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789601281.134244:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789601281.134297:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789601281.134309:0:5832:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789601281.134394:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789601281.134403:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789601281.134442:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789601281.134477:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789601281.134508:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789601281.134518:0:5832:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789601281.134739:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789601281.134748:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789601281.134778:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789601281.135129:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789601281.135311:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789601281.135360:0:5832:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789601281.135367:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789601281.136090:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789601281.136351:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789601281.136371:0:5832:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.130@tcp for mdt 20000000:01000000:1.0:1789601281.136374:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:1.0:1789601281.136410:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789601281.136417:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789601281.136445:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789601281.136453:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:1.0:1789601281.136494:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789601281.136504:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789601281.136533:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789601281.137264:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789601281.137341:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789601281.137345:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789601281.137349:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789601281.137360:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789601281.137373:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789601281.137405:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789601281.137408:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789601281.137830:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789601281.138237:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789601281.138282:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789601281.138317:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1789601281.138329:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789601281.138331:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789601281.138797:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1789601281.139044:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789601281.139093:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1789601281.139149:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1789601281.139162:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789601281.139164:0:5832:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1789601281.139169:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789601281.139172:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789601281.139178:0:5832:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789601281.139184:0:5832:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789601281.139479:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1789601281.139667:0:5832:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1789601281.146059:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1789601281.146125:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1789601281.146176:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1789601281.146192:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789601281.146208:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d7af857e/0xf3d6e402158abc31 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601281.146222:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d7af857e/0xf3d6e402158abc31 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601281.146230:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d7af857e/0xf3d6e402158abc31 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601281.146234:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d7af857e/0xf3d6e402158abc31 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601281.146238:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d7af857e/0xf3d6e402158abc31 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601281.146242:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d7af857e/0xf3d6e402158abc31 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601281.146245:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d7af857e already unused, calling callback (00000000d928263d) 00010000:00010000:3.0:1789601281.146247:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d7af857e/0xf3d6e402158abc31 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601281.146251:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d7af857e/0xf3d6e402158abc31 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601281.146260:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d7af857e/0xf3d6e402158abc31 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601281.146276:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d7af857e/0xf3d6e402158abc31 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601281.146279:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d7af857e/0xf3d6e402158abc31 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789601281.146296:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789601281.367658:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c7dab27b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+5:5818:x1876532880474368:12345-0@lo:253: Request processed in 236483us (236696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601281.367673:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789601281.367780:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d86f9cc pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880474368:0@lo:253: 10000000:01000000:1.0:1789601281.367797:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789601281.367800:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789601281.367802:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789601281.367803:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601281.367804:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1789601281.367805:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601281.367807:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601281.367808:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789601281.367810:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789601281.367811:0:5818:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789601281.367813:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601281.367814:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789601281.367853:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000bbd5ca51 from lustre-MDT0000 10000000:01000000:1.0:1789601281.367884:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789601281.367887:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789601281.367891:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff91edc6010000 10000000:01000000:1.0:1789601281.367895:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789601281.367904:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91edc6010000 from 1 10000000:01000000:1.0:1789601281.367907:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789601281.367964:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 00000000035c2f45/0xf3d6e402158abc38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.367975:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 00000000035c2f45/0xf3d6e402158abc38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.367984:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 00000000035c2f45/0xf3d6e402158abc38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601281.368011:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002192c912 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880474496:0@lo:101: 00000100:00100000:1.0:1789601281.368065:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601281.368131:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ab22f152 going to sleep for 11 seconds 00000100:00100000:2.0:1789601281.368203:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880474496 00000100:00100000:2.0:1789601281.368210:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880474496 00000100:00100000:2.0:1789601281.368249:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789601281.368259:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bd50a54e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+5:5818:x1876532880474496:12345-0@lo:101: 00010000:00010000:2.0:1789601281.368279:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601281.368291:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ae1c9681/0xf3d6e402158abc3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abc38 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601281.368313:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ae1c9681/0xf3d6e402158abc3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abc38 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601281.368323:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ae1c9681/0xf3d6e402158abc3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abc38 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601281.368331:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ae1c9681, rc 0) 00000100:00100000:2.0:1789601281.368360:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bd50a54e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+6:5818:x1876532880474496:12345-0@lo:101: Request processed in 103us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601281.368366:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601281.368586:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002192c912 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880474496:0@lo:101: 00010000:00010000:1.0:1789601281.368599:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 00000000035c2f45/0xf3d6e402158abc38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abc3f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.368607:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 00000000035c2f45/0xf3d6e402158abc38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abc3f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601281.368657:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002192c912 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880474624:0@lo:501: 00000100:00100000:1.0:1789601281.368681:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601281.368706:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ab22f152 going to sleep for 11 seconds 00000100:00100000:2.0:1789601281.368759:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880474624 00000100:00100000:2.0:1789601281.368764:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880474624 00000100:00100000:2.0:1789601281.368792:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789601281.368799:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000abda2f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+6:5818:x1876532880474624:12345-0@lo:501: 00000100:00100000:2.0:1789601281.369043:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000abda2f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+6:5818:x1876532880474624:12345-0@lo:501: Request processed in 245us (362us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789601281.369051:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601281.369141:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002192c912 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880474624:0@lo:501: 10000000:01000000:1.0:1789601281.369167:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789601281.369182:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 00000000035c2f45/0xf3d6e402158abc38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abc3f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.369199:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 00000000035c2f45/0xf3d6e402158abc38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abc3f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601281.369208:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91edd1466000 10000000:01000000:1.0:1789601281.369214:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789601281.369217:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91edd1466000 10000000:01000000:1.0:1789601281.369220:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789601281.369222:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91edd1466000 from 1 10000000:01000000:1.0:1789601281.369230:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789601281.369250:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 000000005970d39f/0xf3d6e402158abc46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.369257:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 000000005970d39f/0xf3d6e402158abc46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.369265:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 000000005970d39f/0xf3d6e402158abc46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601281.369276:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002192c912 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880474752:0@lo:101: 00000100:00100000:1.0:1789601281.369299:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601281.369318:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ab22f152 going to sleep for 11 seconds 00000100:00100000:1.0:1789601281.369335:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880474752 00000100:00100000:1.0:1789601281.369338:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880474752 00000100:00100000:1.0:1789601281.369359:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789601281.369364:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c994e44b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+6:5818:x1876532880474752:12345-0@lo:101: 00010000:00010000:1.0:1789601281.369371:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601281.369381:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004ab33889/0xf3d6e402158abc4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abc46 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.369395:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004ab33889/0xf3d6e402158abc4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abc46 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.369405:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004ab33889/0xf3d6e402158abc4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abc46 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.369411:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004ab33889, rc 0) 00000100:00100000:1.0:1789601281.369435:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c994e44b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+7:5818:x1876532880474752:12345-0@lo:101: Request processed in 72us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601281.369464:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789601281.369492:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002192c912 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880474752:0@lo:101: 00010000:00010000:1.0:1789601281.369500:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 000000005970d39f/0xf3d6e402158abc46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abc4d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.369508:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 000000005970d39f/0xf3d6e402158abc46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abc4d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601281.369517:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789601281.369520:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 000000005970d39f/0xf3d6e402158abc46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abc4d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.369526:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 000000005970d39f/0xf3d6e402158abc46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abc4d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601281.369533:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789601281.369536:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789601281.369540:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91edd1466000 10000000:01000000:1.0:1789601281.369542:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789601281.369545:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789601281.369546:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789601281.369557:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 00000000a5cfc17e/0xf3d6e402158abc54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.369563:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 00000000a5cfc17e/0xf3d6e402158abc54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.369569:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 00000000a5cfc17e/0xf3d6e402158abc54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601281.369588:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002192c912 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880474880:0@lo:101: 00000100:00100000:1.0:1789601281.369610:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601281.369621:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ab22f152 going to sleep for 11 seconds 00000100:00100000:1.0:1789601281.369632:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880474880 00000100:00100000:1.0:1789601281.369636:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880474880 00000100:00100000:1.0:1789601281.369653:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789601281.369658:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d9c6a1c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+7:5818:x1876532880474880:12345-0@lo:101: 00010000:00010000:1.0:1789601281.369664:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601281.369670:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008cea1ae1/0xf3d6e402158abc5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abc54 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.369682:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008cea1ae1/0xf3d6e402158abc5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abc54 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.369689:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008cea1ae1/0xf3d6e402158abc5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abc54 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.369695:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008cea1ae1, rc 0) 00000100:00100000:1.0:1789601281.369719:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d9c6a1c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+8:5818:x1876532880474880:12345-0@lo:101: Request processed in 61us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601281.369724:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789601281.369749:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002192c912 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880474880:0@lo:101: 00010000:00010000:1.0:1789601281.369757:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 00000000a5cfc17e/0xf3d6e402158abc54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abc5b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.369764:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 00000000a5cfc17e/0xf3d6e402158abc54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abc5b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601281.369807:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002192c912 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880475008:0@lo:501: 00000100:00100000:1.0:1789601281.369829:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601281.369867:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ab22f152 going to sleep for 11 seconds 00000100:00100000:1.0:1789601281.369879:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880475008 00000100:00100000:1.0:1789601281.369882:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880475008 00000100:00100000:1.0:1789601281.369899:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789601281.369904:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a60c5419 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+8:5818:x1876532880475008:12345-0@lo:501: 00000100:00100000:1.0:1789601281.370066:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a60c5419 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+9:5818:x1876532880475008:12345-0@lo:501: Request processed in 162us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601281.370088:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789601281.370116:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002192c912 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880475008:0@lo:501: 00000100:00100000:1.0:1789601281.370139:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002192c912 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880475136:0@lo:503: 00000100:00100000:1.0:1789601281.370172:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601281.370183:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ab22f152 going to sleep for 11 seconds 00000100:00100000:1.0:1789601281.370194:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880475136 00000100:00100000:1.0:1789601281.370197:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880475136 00000100:00100000:1.0:1789601281.370214:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789601281.370219:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aeb1662d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+9:5818:x1876532880475136:12345-0@lo:503: 00000100:00100000:1.0:1789601281.370344:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aeb1662d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+9:5818:x1876532880475136:12345-0@lo:503: Request processed in 124us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601281.370350:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789601281.370383:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002192c912 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880475136:0@lo:503: 00000100:00100000:2.0:1789601281.371041:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd72be93 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:5860:1876532880475264:0@lo:502: 00000100:00100000:2.0:1789601281.371094:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601281.371123:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ccf9d1a9 going to sleep for 11 seconds 00000100:00100000:1.0:1789601281.371172:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880475264 00000100:00100000:1.0:1789601281.371177:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880475264 00000100:00100000:1.0:1789601281.371278:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789601281.371285:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000009b9aa44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+9:5860:x1876532880475264:12345-0@lo:502: 00000100:00100000:1.0:1789601281.372009:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000009b9aa44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+9:5860:x1876532880475264:12345-0@lo:502: Request processed in 722us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601281.372018:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789601281.372169:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd72be93 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:5860:1876532880475264:0@lo:502: 00000020:01000000:2.0:1789601281.372266:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601281.372277:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601281.372279:0:5860:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789601281.372290:0:5860:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789601281.372293:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789601281.372308:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000bf5884b9) 00000020:00000080:2.0:1789601281.372325:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789601281.372331:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789601281.372418:0:5860:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789601281.372425:0:5860:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3d6e402158abc69 00000020:00000080:2.0:1789601281.372692:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789601281.372697:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601281.372700:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601281.372701:0:5860:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789601281.372704:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601281.372707:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601281.372709:0:5860:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789601281.372711:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789601281.372717:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000d0a9469c) 00000020:00000080:2.0:1789601281.372726:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789601281.372729:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789601281.372731:0:5860:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789601281.372733:0:5860:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789601281.372739:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789601281.372782:0:5860:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bbd5ca51 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789601281.372793:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000003be3063b) 00000020:00000080:2.0:1789601281.372799:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789601281.372936:0:5860:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789601281.372942:0:5860:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3d6e402158abc7e 00000020:00000080:2.0:1789601281.373024:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789601281.373029:0:5860:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789601281.373034:0:5860:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf3d6e402158abc85 00080000:01000000:2.0:1789601281.373038:0:5860:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789601281.373041:0:5860:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3d6e402158abc8c 00080000:10000000:2.0:1789601281.373540:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1789601281.373743:0:5860:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789601281.379751:0:5860:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789601281.477759:0:5860:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1789601281.478198:0:5860:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1789601281.481066:0:5860:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1789601281.481401:0:5860:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789601281.536346:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000f1b0b719) 00000020:00000080:0.0:1789601281.536371:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789601281.536539:0:5860:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789601281.536547:0:5860:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3d6e402158abc9a 00000020:00000080:0.0:1789601281.538134:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789601281.548722:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789601281.591981:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789601281.620765:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789601281.650082:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789601281.678747:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789601281.714673:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1789601281.739666:0:5860:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf3d6e402158abca1 00000020:00000080:3.0:1789601281.740150:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789601281.740161:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601281.740167:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601281.740169:0:5860:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789601281.740173:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601281.740176:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601281.740177:0:5860:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789601281.740180:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789601281.740182:0:5860:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789601281.740184:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601281.740249:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601281.740251:0:5860:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789601281.740254:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601281.740259:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601281.740260:0:5860:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789601281.740264:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789601281.740298:0:5860:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1789601281.740350:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f1dbf533 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:5860:1876532880475392:0@lo:502: 00000100:00100000:3.0:1789601281.740425:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601281.740513:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a3f72d7f going to sleep for 11 seconds 00000100:00100000:2.0:1789601281.740585:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880475392 00000100:00100000:2.0:1789601281.740592:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880475392 00000100:00100000:2.0:1789601281.740664:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789601281.740673:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004c3e6c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+9:5860:x1876532880475392:12345-0@lo:502: 00000100:00100000:2.0:1789601281.741060:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004c3e6c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+9:5860:x1876532880475392:12345-0@lo:502: Request processed in 388us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601281.741080:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789601281.741157:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f1dbf533 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:5860:1876532880475392:0@lo:502: 00000020:01000000:3.0:1789601281.741182:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601281.741197:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601281.741199:0:5860:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1789601281.741203:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789601281.741418:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789601281.741437:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789601281.741457:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 00000000a5cfc17e/0xf3d6e402158abc54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abc5b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.741474:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 00000000a5cfc17e/0xf3d6e402158abc54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abc5b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601281.741481:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91edd1466000 from 1 10000000:01000000:0.0:1789601281.741484:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789601281.741516:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 000000006b49902f/0xf3d6e402158abca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.741523:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 000000006b49902f/0xf3d6e402158abca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.741531:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 000000006b49902f/0xf3d6e402158abca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601281.741543:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb965808 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880475520:0@lo:101: 00000100:00100000:0.0:1789601281.741571:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601281.741710:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aefd6a34 going to sleep for 11 seconds 00000100:00100000:1.0:1789601281.741797:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880475520 00000100:00100000:1.0:1789601281.741802:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880475520 00000100:00100000:1.0:1789601281.741828:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789601281.741850:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000028a6a90e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+9:5818:x1876532880475520:12345-0@lo:101: 00010000:00010000:1.0:1789601281.741860:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601281.741872:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000651ada8/0xf3d6e402158abcaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abca8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.741893:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000651ada8/0xf3d6e402158abcaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abca8 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.741901:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000651ada8/0xf3d6e402158abcaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abca8 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.741908:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000651ada8, rc 0) 00000100:00100000:1.0:1789601281.741944:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000028a6a90e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+10:5818:x1876532880475520:12345-0@lo:101: Request processed in 111us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601281.741949:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789601281.742025:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb965808 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880475520:0@lo:101: 00010000:00010000:0.0:1789601281.742036:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 000000006b49902f/0xf3d6e402158abca8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abcaf expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.742044:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 000000006b49902f/0xf3d6e402158abca8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abcaf expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601281.742597:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb965808 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880475648:0@lo:256: 00000100:00100000:0.0:1789601281.742637:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601281.742669:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aefd6a34 going to sleep for 11 seconds 00000100:00100000:1.0:1789601281.742804:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880475648 00000100:00100000:1.0:1789601281.742809:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880475648 00000100:00100000:1.0:1789601281.742831:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789601281.742867:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ceba2883 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+10:5818:x1876532880475648:12345-0@lo:256: 20000000:01000000:1.0:1789601281.742890:0:5830:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789601281.742896:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789601281.742957:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ceba2883 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+10:5818:x1876532880475648:12345-0@lo:256: Request processed in 121us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601281.742964:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789601281.743222:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb965808 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880475648:0@lo:256: 10000000:01000000:0.0:1789601281.743743:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789601281.743764:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 000000006b49902f/0xf3d6e402158abca8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abcaf expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.743775:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 000000006b49902f/0xf3d6e402158abca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abcaf expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601281.743783:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91edd1466000 from 1 10000000:01000000:0.0:1789601281.743786:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789601281.743811:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 00000000d2240671/0xf3d6e402158abcb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.743818:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 00000000d2240671/0xf3d6e402158abcb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.743826:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 00000000d2240671/0xf3d6e402158abcb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601281.743860:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb965808 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880475776:0@lo:101: 00000100:00100000:0.0:1789601281.743893:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601281.743913:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aefd6a34 going to sleep for 11 seconds 00000100:00100000:1.0:1789601281.744037:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880475776 00000100:00100000:1.0:1789601281.744042:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880475776 00000100:00100000:1.0:1789601281.744074:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789601281.744080:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bb943477 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+10:5818:x1876532880475776:12345-0@lo:101: 00010000:00010000:1.0:1789601281.744089:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601281.744100:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003d714da1/0xf3d6e402158abcbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abcb6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.744118:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003d714da1/0xf3d6e402158abcbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abcb6 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.744126:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003d714da1/0xf3d6e402158abcbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abcb6 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601281.744133:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003d714da1, rc 0) 00000100:00100000:1.0:1789601281.744167:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bb943477 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:5818:x1876532880475776:12345-0@lo:101: Request processed in 87us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601281.744173:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789601281.744468:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb965808 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880475776:0@lo:101: 00010000:00010000:0.0:1789601281.744481:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 00000000d2240671/0xf3d6e402158abcb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abcbd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.744489:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 00000000d2240671/0xf3d6e402158abcb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abcbd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601281.744553:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb965808 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880475904:0@lo:501: 00000100:00100000:0.0:1789601281.744577:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601281.744603:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aefd6a34 going to sleep for 11 seconds 00000100:00100000:1.0:1789601281.744653:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880475904 00000100:00100000:1.0:1789601281.744657:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880475904 00000100:00100000:1.0:1789601281.744684:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789601281.744689:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000032590c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:5818:x1876532880475904:12345-0@lo:501: 00000100:00100000:1.0:1789601281.745366:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000032590c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:5818:x1876532880475904:12345-0@lo:501: Request processed in 676us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601281.745380:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789601281.745560:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb965808 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880475904:0@lo:501: 00000100:00100000:0.0:1789601281.745596:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb965808 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880476032:0@lo:503: 00000100:00100000:0.0:1789601281.745631:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601281.745662:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aefd6a34 going to sleep for 11 seconds 00000100:00100000:2.0:1789601281.745733:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880476032 00000100:00100000:2.0:1789601281.745738:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880476032 00000100:00100000:2.0:1789601281.745762:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789601281.745768:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008f4d5db8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:5818:x1876532880476032:12345-0@lo:503: 00000040:00080000:2.0:1789601281.745811:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789601281.745878:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008f4d5db8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:5818:x1876532880476032:12345-0@lo:503: Request processed in 111us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601281.745885:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789601281.745964:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb965808 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880476032:0@lo:503: 00000040:00080000:0.0:1789601281.747094:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789601281.747439:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789601281.747459:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789601281.747515:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 00000000d2240671/0xf3d6e402158abcb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abcbd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601281.747529:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 00000000d2240671/0xf3d6e402158abcb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abcbd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601281.747573:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789601281.747586:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91edd1466000 10000000:01000000:2.0:1789601281.747588:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91edd1466000 10000000:01000000:2.0:1789601281.747592:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789601281.747598:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91edd1466000 from 1 10000000:01000000:2.0:1789601281.747600:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789601281.747632:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 000000009dbf4de3/0xf3d6e402158abcc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601281.747639:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 000000009dbf4de3/0xf3d6e402158abcc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601281.747648:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 000000009dbf4de3/0xf3d6e402158abcc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601281.747667:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd72be93 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880476160:0@lo:101: 00000100:00100000:2.0:1789601281.747718:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601281.747754:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 0000000023494708 going to sleep for 11 seconds 00000100:00100000:3.0:1789601281.747799:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880476160 00000100:00100000:3.0:1789601281.747805:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880476160 00000100:00100000:3.0:1789601281.747866:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789601281.747873:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003fe7898e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:5818:x1876532880476160:12345-0@lo:101: 00010000:00010000:3.0:1789601281.747883:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601281.747893:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d7af857e/0xf3d6e402158abccb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abcc4 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601281.747912:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d7af857e/0xf3d6e402158abccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abcc4 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601281.747921:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d7af857e/0xf3d6e402158abccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abcc4 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601281.747930:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d7af857e, rc 0) 00000100:00100000:3.0:1789601281.747964:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003fe7898e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5818:x1876532880476160:12345-0@lo:101: Request processed in 92us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601281.747970:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789601281.748098:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd72be93 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880476160:0@lo:101: 00010000:00010000:2.0:1789601281.748110:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 000000009dbf4de3/0xf3d6e402158abcc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abccb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601281.748119:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 000000009dbf4de3/0xf3d6e402158abcc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abccb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601281.748158:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd72be93 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880476288:0@lo:501: 00000100:00100000:2.0:1789601281.748178:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601281.748284:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 0000000023494708 going to sleep for 11 seconds 00000100:00100000:0.0:1789601281.748382:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880476288 00000100:00100000:0.0:1789601281.748386:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880476288 00000100:00100000:0.0:1789601281.748434:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789601281.748441:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009e1dfcd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5818:x1876532880476288:12345-0@lo:501: 00000100:00100000:0.0:1789601281.748719:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009e1dfcd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5818:x1876532880476288:12345-0@lo:501: Request processed in 279us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601281.748727:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789601281.748786:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd72be93 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880476288:0@lo:501: 00000100:00100000:2.0:1789601281.748812:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd72be93 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880476416:0@lo:503: 00000100:00100000:2.0:1789601281.748996:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601281.749026:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 0000000023494708 going to sleep for 11 seconds 00000100:00100000:1.0:1789601281.749080:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880476416 00000100:00100000:1.0:1789601281.749084:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880476416 00000100:00100000:1.0:1789601281.749116:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789601281.749122:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004e8387f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5818:x1876532880476416:12345-0@lo:503: 00000100:00100000:1.0:1789601281.749522:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004e8387f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5818:x1876532880476416:12345-0@lo:503: Request processed in 399us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601281.749530:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789601281.749605:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd72be93 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880476416:0@lo:503: 00000100:00100000:1.0:1789601281.750057:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002192c912 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:5865:1876532880476544:0@lo:502: 00000100:00100000:1.0:1789601281.750114:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601281.750175:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set 000000001a702cb3 going to sleep for 11 seconds 00000100:00100000:3.0:1789601281.750276:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880476544 00000100:00100000:3.0:1789601281.750282:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880476544 00000100:00100000:3.0:1789601281.750340:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789601281.750347:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003100800d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5865:x1876532880476544:12345-0@lo:502: 00000100:00100000:3.0:1789601281.750551:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003100800d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5865:x1876532880476544:12345-0@lo:502: Request processed in 205us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601281.750564:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789601281.750634:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002192c912 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:5865:1876532880476544:0@lo:502: 00000020:01000004:2.0:1789601281.750688:0:5865:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789601281.750713:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000003d5011cb) 00000020:00000080:2.0:1789601281.750729:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789601281.750794:0:5865:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000bbd5ca51 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789601281.750799:0:5865:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000bbd5ca51 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789601281.750801:0:5865:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000bbd5ca51 4 00010000:00080000:2.0:1789601281.750827:0:5865:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007dc3d4a6@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:2.0:1789601281.752457:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789601281.752633:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789601281.752664:0:5865:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789601281.752675:0:5865:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf3d6e402158abcd9 00000100:00080000:2.0:1789601281.752683:0:5865:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789601281.752693:0:5865:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000007dc3d4a6 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1789601281.752728:0:5865:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dd72be93 x1876532880476672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789601281.752747:0:5865:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789601281.754507:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dd72be93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876532880476672:0@lo:38: 00000100:00100000:0.0:1789601281.754584:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601281.754913:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880476672 00000100:00100000:1.0:1789601281.754923:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880476672 00000100:00100000:1.0:1789601281.754951:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789601281.754957:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bb965808 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1876532880476672:12345-0@lo:38: 00000100:00100000:1.0:1789601281.755016:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bb965808 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1876532880476672:12345-0@lo:38: Request processed in 57us (431us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789601281.755023:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601281.756382:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789601281.756394:0:3316:0:(import.c:65:import_set_state_nolock()) 000000007dc3d4a6 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789601281.756401:0:3316:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789601281.756405:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dd72be93 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876532880476672:0@lo:38: 00000100:00100000:2.0:1789601281.758537:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e95d86eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:5865:1876532880476800:0@lo:502: 00000100:00100000:2.0:1789601281.758621:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601281.758670:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set 0000000040fc9894 going to sleep for 11 seconds 00000100:00100000:0.0:1789601281.758724:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880476800 00000100:00100000:0.0:1789601281.758732:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880476800 00000100:00100000:0.0:1789601281.758791:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789601281.758799:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000174504a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5865:x1876532880476800:12345-0@lo:502: 00000100:00100000:0.0:1789601281.759079:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000174504a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5865:x1876532880476800:12345-0@lo:502: Request processed in 282us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601281.759087:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789601281.759399:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e95d86eb pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:5865:1876532880476800:0@lo:502: 00000040:00080000:2.0:1789601281.759426:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789601281.759575:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789601281.759600:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789601281.759621:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 000000009dbf4de3/0xf3d6e402158abcc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abccb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.759631:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 000000009dbf4de3/0xf3d6e402158abcc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abccb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789601281.759678:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789601281.759681:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789601281.759682:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601281.759684:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601281.759685:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601281.759686:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601281.759687:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789601281.759689:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789601281.759690:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789601281.759691:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789601281.759693:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601281.759694:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789601281.759697:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789601281.759700:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789601281.759702:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789601281.759703:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601281.759704:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601281.759705:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601281.759706:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601281.759707:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789601281.759708:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789601281.759709:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789601281.759715:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789601281.759716:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601281.759716:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789601281.759734:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789601281.759744:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b845e41 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880476928:0@lo:253: 00000100:00100000:0.0:1789601281.759779:0:5818:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601281.759811:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f092519e going to sleep for 11 seconds 00000100:00100000:2.0:1789601281.759947:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880476928 00000100:00100000:2.0:1789601281.759959:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880476928 00000100:00100000:2.0:1789601281.759998:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789601281.760005:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f0fed3b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5818:x1876532880476928:12345-0@lo:253: 20000000:01000000:2.0:1789601281.760029:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789601281.760045:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789601281.780304:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789601281.780358:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789601281.783123:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789601281.783134:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789601281.783414:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001863d73d/0xf3d6e402158abce0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601281.783436:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000651ada8/0xf3d6e402158abcaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abca8 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601281.783444:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001863d73d/0xf3d6e402158abce0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601281.783488:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000651ada8/0xf3d6e402158abcaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abca8 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601281.783502:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000651ada8/0xf3d6e402158abcaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abca8 expref: 12 pid: 5830 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601281.783516:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e95d86eb pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1876532880477056:0@lo:104: 00000100:00100000:2.0:1789601281.783578:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601281.783691:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880477056 00000100:00100000:3.0:1789601281.783698:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880477056 00000100:00100000:2.0:1789601281.783741:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set 00000000589bae4e going to sleep for 11 seconds 00000100:00100000:3.0:1789601281.783956:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789601281.783964:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dd62db07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:5853:x1876532880477056:12345-0@lo:104: 00010000:00010000:3.0:1789601281.783976:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: 000000006b49902f/0xf3d6e402158abca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abcaf expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601281.784121:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789601281.784127:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dd62db07 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:5853:x1876532880477056:12345-0@lo:104: Request processed in 164us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601281.784135:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789601281.784203:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601281.784210:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: 000000006b49902f/0xf3d6e402158abca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abcaf expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.784217:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006b49902f already unused, calling callback (000000008d11be45) 10000000:00010000:0.0:1789601281.784220:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: 000000006b49902f/0xf3d6e402158abca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abcaf expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.784227:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: 000000006b49902f/0xf3d6e402158abca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abcaf expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601281.784234:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: 000000006b49902f/0xf3d6e402158abca8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abcaf expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601281.784239:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789601281.784270:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: 000000006b49902f/0xf3d6e402158abca8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abcaf expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.784276:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601281.784288:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: 000000006b49902f/0xf3d6e402158abca8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abcaf expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.784293:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: 000000006b49902f/0xf3d6e402158abca8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abcaf expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.784326:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601281.784328:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601281.784330:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601281.784418:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a5ce7de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880477184:0@lo:103: 00000100:00100000:3.0:1789601281.784448:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601281.784614:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880477184 00000100:00100000:0.0:1789601281.784618:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880477184 00010000:00010000:0.0:1789601281.784637:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000651ada8/0xf3d6e402158abcaf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abca8 expref: 13 pid: 5830 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601281.784665:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601281.784671:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f1dbf533 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:3318:x1876532880477184:12345-0@lo:103: 00010000:00010000:0.0:1789601281.784679:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601281.784683:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000651ada8/0xf3d6e402158abcaf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abca8 expref: 13 pid: 5830 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.784691:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000651ada8/0xf3d6e402158abcaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abca8 expref: 13 pid: 5830 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.784705:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001863d73d/0xf3d6e402158abce0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.784712:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001863d73d/0xf3d6e402158abce0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789601281.784724:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001591811s 00010000:00010000:0.0:1789601281.784728:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001863d73d/0xf3d6e402158abce0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.784733:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001863d73d/0xf3d6e402158abce0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.784748:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001863d73d/0xf3d6e402158abce0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.784754:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001863d73d/0xf3d6e402158abce0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.784759:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001863d73d already unused, calling callback (00000000d928263d) 00010000:00010000:0.0:1789601281.784762:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001863d73d/0xf3d6e402158abce0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.784769:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001863d73d/0xf3d6e402158abce0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.784776:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001863d73d/0xf3d6e402158abce0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.784786:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601281.784814:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f1dbf533 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:3318:x1876532880477184:12345-0@lo:103: Request processed in 144us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601281.784820:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789601281.785294:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a5ce7de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880477184:0@lo:103: 00010000:00010000:1.0:1789601281.786519:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000651ada8/0xf3d6e402158abcaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abca8 expref: 12 pid: 5830 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601281.786538:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e95d86eb pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1876532880477056:0@lo:104: 00010000:00010000:1.0:1789601281.786561:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001863d73d/0xf3d6e402158abce0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.786626:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001863d73d/0xf3d6e402158abce0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.786633:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001863d73d/0xf3d6e402158abce0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601281.786639:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001863d73d/0xf3d6e402158abce0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601281.786999:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f0fed3b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:5818:x1876532880476928:12345-0@lo:253: Request processed in 26995us (27219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601281.787021:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789601281.787119:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b845e41 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:5818:1876532880476928:0@lo:253: 10000000:01000000:2.0:1789601281.787133:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789601281.787136:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789601281.787138:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789601281.787139:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789601281.787141:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789601281.787152:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789601281.787153:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789601281.787155:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789601281.787156:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789601281.787158:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789601281.787159:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789601281.787160:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789601281.787162:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789601281.787174:0:5818:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789601281.792046:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789601281.792443:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789601281.792645:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789601281.792818:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789601281.793040:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789601281.793222:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789601281.794877:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789601281.795032:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789601281.795228:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789601281.795370:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789601281.795550:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789601281.795687:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1789601281.834101:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1789601281.858799:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1789601281.859003:0:5871:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789601281.860590:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789601281.860691:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789601281.861035:0:5818:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789601281.861041:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789601281.861148:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789601281.865235:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789601281.865748:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789601281.865776:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000020:00080000:2.0:1789601281.865940:0:5870:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789601281.865945:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:1.0:1789601281.866460:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789601281.866686:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1789601281.867869:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789601281.867977:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789601281.868094:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789601281.868212:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789601281.868322:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789601281.868447:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789601281.868526:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789601281.868614:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789601281.868701:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789601281.868789:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789601281.868903:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789601281.868994:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789601281.869810:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789601281.869944:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789601281.870021:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789601281.870149:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789601281.877911:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789601281.878057:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789601281.878693:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789601281.878866:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789601281.878995:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789601281.879133:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789601281.879335:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789601281.879511:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789601281.879640:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789601281.879791:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789601281.879944:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789601281.880095:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789601281.880526:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789601281.880689:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789601281.880824:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789601281.881146:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789601281.881479:0:5818:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1789601281.900873:0:5871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1789601281.947717:0:5818:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789601281.947753:0:5818:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf6781c6f988 00100000:10000000:2.0:1789601281.947761:0:5818:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789601281.949711:0:5818:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789601281.949728:0:5818:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789601281.949743:0:5818:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789601281.949760:0:5818:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1789601281.995685:0:5871:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789601281.995752:0:5871:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789601281.995757:0:5871:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789601282.062356:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601283.081150:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601284.107132:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601285.132867:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601286.152975:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789601286.958497:0:6114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1789601287.113249:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789601287.113259:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789601287.113262:0:38:0:(import.c:65:import_set_state_nolock()) 000000007dc3d4a6 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789601287.113279:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000007dc3d4a6 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1789601287.113306:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f212e9a1 x1876532880477440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789601287.113345:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f212e9a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876532880477440:0@lo:38: 00000100:00100000:0.0:1789601287.113407:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601287.113585:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789601287.113593:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005e4abda7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880477312:0@lo:400: 00000100:00100000:0.0:1789601287.113624:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601287.113680:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880477312 00000100:00100000:0.0:1789601287.113687:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880477312 00000100:00100000:0.0:1789601287.113722:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789601287.113729:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000026066b67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:3320:x1876532880477312:12345-0@lo:400: 00000100:00100000:0.0:1789601287.113776:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000026066b67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:3320:x1876532880477312:12345-0@lo:400: Request processed in 48us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601287.113782:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789601287.113826:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005e4abda7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880477312:0@lo:400: 00000100:00100000:0.0:1789601287.113883:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880477440 00000100:00100000:0.0:1789601287.113887:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880477440 00000100:00100000:0.0:1789601287.113905:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789601287.113909:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ac9ce035 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3316:x1876532880477440:12345-0@lo:38: 00010000:00080000:0.0:1789601287.113927:0:5839:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:0.0:1789601287.113959:0:5839:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf3d6e402158abce7 00000004:00100000:0.0:1789601287.114013:0:5839:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789601287.114234:0:5839:0:(import.c:65:import_set_state_nolock()) 000000009739c7b0 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601287.114277:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ac9ce035 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876532880477440:12345-0@lo:38: Request processed in 366us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601287.114283:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789601287.114320:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f212e9a1 x1876532880477440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789601297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789601287.114334:0:3316:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789601287.114341:0:3316:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789601287.114346:0:3316:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789601287.114348:0:3316:0:(import.c:65:import_set_state_nolock()) 000000007dc3d4a6 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789601287.114353:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f212e9a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876532880477440:0@lo:38: 00010000:00010000:1.0:1789601287.187222:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601288.204054:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601289.227593:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789601289.673199:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789601289.673231:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91edd1466000 from 3 10000000:01000000:3.0:1789601289.673237:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789601289.673281:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 000000003d855d7d/0xf3d6e402158abcee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601289.673293:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 000000003d855d7d/0xf3d6e402158abcee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601289.673303:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 000000003d855d7d/0xf3d6e402158abcee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601289.673325:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf8e00e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880477568:0@lo:101: 00000100:00100000:3.0:1789601289.673396:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601289.673457:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a06feaff going to sleep for 11 seconds 00000100:00100000:0.0:1789601289.673713:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880477568 00000100:00100000:0.0:1789601289.673731:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880477568 00000100:00100000:0.0:1789601289.673830:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789601289.673861:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dc9a7b03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:5834:x1876532880477568:12345-0@lo:101: 00010000:00010000:0.0:1789601289.673875:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601289.673898:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000271ce4f2/0xf3d6e402158abcf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abcee expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601289.673919:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000271ce4f2/0xf3d6e402158abcf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abcee expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601289.673938:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000271ce4f2/0xf3d6e402158abcf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abcee expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601289.673946:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000271ce4f2, rc 0) 00000100:00100000:0.0:1789601289.673991:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dc9a7b03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5834:x1876532880477568:12345-0@lo:101: Request processed in 133us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601289.673998:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789601289.677320:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf8e00e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880477568:0@lo:101: 00010000:00010000:3.0:1789601289.677348:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 000000003d855d7d/0xf3d6e402158abcee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abcf5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601289.677362:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 000000003d855d7d/0xf3d6e402158abcee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abcf5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601289.677439:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf8e00e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880477696:0@lo:256: 00000100:00100000:3.0:1789601289.677501:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601289.681628:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a06feaff going to sleep for 11 seconds 00000100:00100000:2.0:1789601289.683188:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880477696 00000100:00100000:2.0:1789601289.683203:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880477696 00000100:00100000:2.0:1789601289.683333:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789601289.683343:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e8623158 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5834:x1876532880477696:12345-0@lo:256: 20000000:01000000:2.0:1789601289.683387:0:5830:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789601289.683403:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789601289.683406:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789601289.683645:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e8623158 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5834:x1876532880477696:12345-0@lo:256: Request processed in 303us (6144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601289.683653:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789601289.684576:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf8e00e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880477696:0@lo:256: 10000000:01000000:3.0:1789601289.684637:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789601289.684645:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: 000000003d855d7d/0xf3d6e402158abcee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abcf5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601289.684667:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: 000000003d855d7d/0xf3d6e402158abcee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abcf5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601290.252078:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601291.282405:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789601292.153117:0:6316:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1d083200 20000000:00000080:3.0:1789601292.153136:0:6316:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91edf9d75c00 uarg=0000000000000000 20000000:01000000:3.0:1789601292.153167:0:6316:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789601292.153175:0:6316:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789601292.153179:0:6316:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789601292.153394:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789601292.153407:0:6316:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789601292.158955:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789601292.160573:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789601292.160661:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789601292.160708:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789601292.160727:0:6316:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789601292.160744:0:6316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c03153d6/0xf3d6e402158abcfc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601292.160762:0:6316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003d714da1/0xf3d6e402158abcbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abcb6 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601292.160769:0:6316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c03153d6/0xf3d6e402158abcfc lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601292.160804:0:6316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003d714da1/0xf3d6e402158abcbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abcb6 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601292.160818:0:6316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003d714da1/0xf3d6e402158abcbd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abcb6 expref: 11 pid: 5830 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601292.160864:0:6316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bf8e00e6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1876532880477824:0@lo:104: 00000100:00100000:3.0:1789601292.160934:0:6316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601292.160985:0:6316:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a40ea6b8 going to sleep for 11 seconds 00000100:00100000:2.0:1789601292.163130:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880477824 00000100:00100000:2.0:1789601292.163146:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880477824 00000100:00100000:2.0:1789601292.163202:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789601292.163209:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b8cd5115 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:6316:x1876532880477824:12345-0@lo:104: 00010000:00010000:2.0:1789601292.163226:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: 00000000d2240671/0xf3d6e402158abcb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abcbd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601292.163322:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789601292.163327:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b8cd5115 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:6316:x1876532880477824:12345-0@lo:104: Request processed in 118us (2394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601292.163333:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789601292.163355:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601292.163360:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: 00000000d2240671/0xf3d6e402158abcb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abcbd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601292.163366:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d2240671 already unused, calling callback (000000008d11be45) 00000100:00100000:3.0:1789601292.163367:0:6316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bf8e00e6 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1876532880477824:0@lo:104: 10000000:00010000:2.0:1789601292.163370:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: 00000000d2240671/0xf3d6e402158abcb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abcbd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601292.163377:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: 00000000d2240671/0xf3d6e402158abcb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abcbd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601292.163382:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: 00000000d2240671/0xf3d6e402158abcb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abcbd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601292.163390:0:6316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c03153d6/0xf3d6e402158abcfc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601292.163399:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789601292.163447:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: 00000000d2240671/0xf3d6e402158abcb6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abcbd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601292.163455:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601292.163469:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: 00000000d2240671/0xf3d6e402158abcb6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abcbd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601292.163476:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: 00000000d2240671/0xf3d6e402158abcb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abcbd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601292.163492:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601292.163494:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601292.163496:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601292.163784:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fed8daeb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880477952:0@lo:103: 00000100:00100000:0.0:1789601292.163825:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601292.164565:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880477952 00000100:00100000:3.0:1789601292.164574:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880477952 00010000:00010000:3.0:1789601292.164599:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003d714da1/0xf3d6e402158abcbd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abcb6 expref: 12 pid: 5830 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601292.164632:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789601292.164639:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f212e9a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:3320:x1876532880477952:12345-0@lo:103: 00010000:00010000:3.0:1789601292.164652:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601292.164656:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003d714da1/0xf3d6e402158abcbd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abcb6 expref: 12 pid: 5830 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601292.164666:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003d714da1/0xf3d6e402158abcbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abcb6 expref: 12 pid: 5830 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601292.164679:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003d714da1/0xf3d6e402158abcbd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abcb6 expref: 12 pid: 5830 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601292.164691:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c03153d6/0xf3d6e402158abcfc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601292.164699:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c03153d6/0xf3d6e402158abcfc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601292.164722:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c03153d6/0xf3d6e402158abcfc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601292.164729:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c03153d6/0xf3d6e402158abcfc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601292.164734:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c03153d6/0xf3d6e402158abcfc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601292.164740:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c03153d6/0xf3d6e402158abcfc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601292.164745:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c03153d6 already unused, calling callback (00000000d928263d) 00010000:00010000:3.0:1789601292.164749:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c03153d6/0xf3d6e402158abcfc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601292.164756:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c03153d6/0xf3d6e402158abcfc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601292.164777:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c03153d6/0xf3d6e402158abcfc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601292.164787:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601292.164860:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f212e9a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:3320:x1876532880477952:12345-0@lo:103: Request processed in 222us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601292.164867:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789601292.164887:0:6316:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c03153d6/0xf3d6e402158abcfc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601292.164896:0:6316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c03153d6/0xf3d6e402158abcfc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601292.164902:0:6316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c03153d6/0xf3d6e402158abcfc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601292.166249:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fed8daeb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880477952:0@lo:103: 00000100:00100000:3.0:1789601292.239516:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fed8daeb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880478080:0@lo:400: 00000100:00100000:3.0:1789601292.239621:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601292.239699:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880478080 00000100:00100000:1.0:1789601292.239708:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880478080 00000100:00100000:1.0:1789601292.239757:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789601292.239765:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bf8e00e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880478080:12345-0@lo:400: 00000100:00100000:1.0:1789601292.239832:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bf8e00e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880478080:12345-0@lo:400: Request processed in 69us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601292.239854:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789601292.240493:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fed8daeb x1876532880478080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601292.240519:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fed8daeb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880478080:0@lo:400: 00010000:00010000:1.0:1789601292.297686:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601293.321592:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601294.345206:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601295.376128:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601296.396828:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789601297.354081:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789601297.354093:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91edd1466000 from 1 10000000:01000000:3.0:1789601297.354100:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789601297.354168:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: 000000009eb58261/0xf3d6e402158abd03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601297.354185:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: 000000009eb58261/0xf3d6e402158abd03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601297.354200:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: 000000009eb58261/0xf3d6e402158abd03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601297.354250:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031b6d3ae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880478208:0@lo:101: 00000100:00100000:3.0:1789601297.354358:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601297.354430:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set 000000009265fad5 going to sleep for 11 seconds 00000100:00100000:3.0:1789601297.354498:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880478208 00000100:00100000:3.0:1789601297.354510:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880478208 00000100:00100000:3.0:1789601297.354573:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789601297.354582:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002173d176 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:5834:x1876532880478208:12345-0@lo:101: 00010000:00010000:3.0:1789601297.354598:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601297.354613:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000e4cb9bf/0xf3d6e402158abd0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abd03 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601297.354643:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000e4cb9bf/0xf3d6e402158abd0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abd03 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601297.354676:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000e4cb9bf/0xf3d6e402158abd0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abd03 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601297.354687:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000e4cb9bf, rc 0) 00000100:00100000:3.0:1789601297.354732:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002173d176 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5834:x1876532880478208:12345-0@lo:101: Request processed in 150us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601297.354738:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789601297.355194:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031b6d3ae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880478208:0@lo:101: 00010000:00010000:3.0:1789601297.355213:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: 000000009eb58261/0xf3d6e402158abd03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abd0a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601297.355222:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: 000000009eb58261/0xf3d6e402158abd03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abd0a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601297.355295:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031b6d3ae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880478336:0@lo:501: 00000100:00100000:3.0:1789601297.355332:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601297.355350:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set 000000009265fad5 going to sleep for 11 seconds 00000100:00100000:3.0:1789601297.355364:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880478336 00000100:00100000:3.0:1789601297.355368:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880478336 00000100:00100000:3.0:1789601297.355392:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789601297.355397:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f29f330e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5834:x1876532880478336:12345-0@lo:501: 00000100:00100000:3.0:1789601297.355750:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f29f330e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5834:x1876532880478336:12345-0@lo:501: Request processed in 351us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601297.355758:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789601297.355812:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031b6d3ae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880478336:0@lo:501: 00000100:00100000:3.0:1789601297.355871:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031b6d3ae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880478464:0@lo:503: 00000100:00100000:3.0:1789601297.355921:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601297.355937:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set 000000009265fad5 going to sleep for 11 seconds 00000100:00100000:3.0:1789601297.355953:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880478464 00000100:00100000:3.0:1789601297.355956:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880478464 00000100:00100000:3.0:1789601297.355977:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789601297.355984:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000060e831f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5834:x1876532880478464:12345-0@lo:503: 00000100:00100000:3.0:1789601297.356316:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000060e831f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5834:x1876532880478464:12345-0@lo:503: Request processed in 333us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601297.356323:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789601297.356363:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031b6d3ae pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880478464:0@lo:503: 00000100:00100000:0.0:1789601297.361398:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005e4abda7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880478592:0@lo:400: 00000100:00100000:0.0:1789601297.361515:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601297.361604:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880478592 00000100:00100000:0.0:1789601297.361615:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880478592 00000100:00100000:0.0:1789601297.361677:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789601297.361688:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f2f8e468 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880478592:12345-0@lo:400: 00000100:00100000:0.0:1789601297.361754:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f2f8e468 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880478592:12345-0@lo:400: Request processed in 68us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601297.361762:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789601297.361833:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005e4abda7 x1876532880478592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601297.361889:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005e4abda7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880478592:0@lo:400: 00000100:00100000:2.0:1789601297.364648:0:6605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000063920c3b pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:6605:1876532880478720:0@lo:502: 00000100:00100000:2.0:1789601297.364768:0:6605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601297.369412:0:6605:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc26c689 going to sleep for 11 seconds 00000100:00100000:0.0:1789601297.370084:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880478720 00000100:00100000:0.0:1789601297.370100:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880478720 00000100:00100000:0.0:1789601297.373443:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789601297.373610:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000469a7618 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:6605:x1876532880478720:12345-0@lo:502: 00000100:00100000:0.0:1789601297.374412:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000469a7618 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:6605:x1876532880478720:12345-0@lo:502: Request processed in 954us (9643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601297.374424:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789601297.374475:0:6605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000063920c3b pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:6605:1876532880478720:0@lo:502: 00000020:01000000:2.0:1789601297.374521:0:6605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601297.374533:0:6605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601297.374536:0:6605:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789601297.374544:0:6605:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91edd1466000 00000020:00000080:2.0:1789601297.374547:0:6605:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789601297.374617:0:6605:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c81880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:6605:1876532880478848:0@lo:502: 00000100:00100000:2.0:1789601297.374690:0:6605:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601297.376356:0:6605:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8dcbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601297.382021:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880478848 00000100:00100000:1.0:1789601297.382048:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880478848 00000100:00100000:1.0:1789601297.382115:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789601297.382129:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:6605:x1876532880478848:12345-0@lo:502: 00000100:00100000:1.0:1789601297.382704:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:6605:x1876532880478848:12345-0@lo:502: Request processed in 577us (8012us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601297.382713:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789601297.382964:0:6605:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c81880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:6605:1876532880478848:0@lo:502: 00000020:01000000:0.0:1789601297.383012:0:6605:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601297.383023:0:6605:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601297.383026:0:6605:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789601297.383032:0:6605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789601297.383971:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789601297.384011:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789601297.384027:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee02045e00/0xf3d6e402158abd03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abd0a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601297.384052:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91ee02045e00/0xf3d6e402158abd03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abd0a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601297.417746:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601298.444464:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789601299.125576:0:6674:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789601299.125582:0:6674:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789601299.125718:0:6674:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91edc825a800 00000020:01000004:2.0:1789601299.125741:0:6674:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789601299.125765:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789601299.125785:0:6674:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff91edc82cb380) 00000020:00000080:2.0:1789601299.125805:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789601299.186742:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789601299.187317:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789601299.211776:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789601299.216945:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789601299.216988:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789601299.217058:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789601299.217348:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789601299.217801:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789601299.217817:0:6674:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789601299.217831:0:6674:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf3d6e402158abd18 00000020:01000004:1.0:1789601299.217928:0:6674:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1789601299.217959:0:6674:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.130@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789601299.217964:0:6674:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789601299.217971:0:6674:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789601299.217977:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789601299.217995:0:6674:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff91edc60119c0) 00000020:00000080:1.0:1789601299.218006:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:1.0:1789601299.219787:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789601299.220162:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789601299.220172:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789601299.221803:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789601299.221816:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789601299.223811:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789601299.223825:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789601299.229306:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789601299.229536:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789601299.229543:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789601299.232699:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789601299.232715:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789601299.267420:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789601299.267795:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789601299.267805:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789601299.269268:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789601299.269279:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789601299.270405:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789601299.270417:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789601299.272302:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789601299.272619:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789601299.272628:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789601299.278480:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789601299.278507:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789601299.351220:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789601299.351515:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789601299.351544:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789601299.372606:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789601299.372629:0:6674:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789601299.376353:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789601299.376408:0:6674:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789601299.376417:0:6674:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789601299.437578:0:6674:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789601299.437638:0:6674:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.130@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1789601299.437643:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789601299.437646:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789601299.437647:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789601299.437649:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789601299.437650:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789601299.437652:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789601299.437653:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789601299.437655:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789601299.437656:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789601299.437658:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789601299.437660:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789601299.437665:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1789601299.437667:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789601299.437668:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789601299.437673:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789601299.437674:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789601299.437675:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789601299.437676:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789601299.437677:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789601299.437678:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789601299.437679:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789601299.437680:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789601299.437680:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789601299.437721:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789601299.437746:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8deb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880478976:0@lo:253: 00000100:00100000:3.0:1789601299.438573:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601299.438709:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede9e69000 going to sleep for 11 seconds 00000100:00100000:1.0:1789601299.440326:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880478976 00000100:00100000:1.0:1789601299.440348:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880478976 00000100:00100000:1.0:1789601299.440458:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789601299.440489:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:6674:x1876532880478976:12345-0@lo:253: 20000000:01000000:1.0:1789601299.440538:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789601299.440543:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789601299.440550:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789601299.440554:0:5832:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789601299.442406:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789601299.442723:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789601299.442741:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789601299.442799:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1789601299.442809:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789601299.442876:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1789601299.443133:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1789601299.443811:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789601299.444656:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.130@tcp 20000000:01000000:1.0:1789601299.444661:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:1.0:1789601299.444744:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789601299.444768:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789601299.444831:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789601299.446690:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:1.0:1789601299.447361:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789601299.447380:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789601299.447499:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789601299.447646:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1789601299.457788:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789601299.458136:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.130@tcp 20000000:01000000:0.0:1789601299.458141:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:0.0:1789601299.458194:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789601299.458204:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789601299.458237:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789601299.458383:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:0.0:1789601299.458526:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789601299.458541:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789601299.458575:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1789601299.458612:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1789601299.458636:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789601299.458639:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789601299.458645:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789601299.458662:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789601299.458666:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789601299.458713:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789601299.458715:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789601299.461214:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1789601299.461646:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1789601299.461706:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789601299.462903:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1789601299.462961:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1789601299.462998:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1789601299.463013:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789601299.463016:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00010000:00010000:2.0:1789601299.465535:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789601299.467187:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1789601299.468660:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1789601299.468720:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1789601299.470090:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1789601299.470133:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789601299.470137:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789601299.484977:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789601299.485105:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789601299.485161:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789601299.485920:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789601299.485972:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789601299.486040:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1789601299.486059:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1789601299.486062:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1789601299.486073:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789601299.486099:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd26 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.486122:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc29c5800/0xf3d6e402158abc3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abc38 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.486130:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abc5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abc54 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.486138:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ee02045400/0xf3d6e402158abccb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abcc4 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.486146:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd26 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.486198:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ee02045400/0xf3d6e402158abccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abcc4 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.486217:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ee02045400/0xf3d6e402158abccb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abcc4 expref: 12 pid: 5832 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601299.486236:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d93100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876532880479104:0@lo:104: 00000100:00100000:2.0:1789601299.486908:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789601299.487222:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abc5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abc54 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.487237:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abc5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abc54 expref: 12 pid: 5831 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601299.487249:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c82d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876532880479232:0@lo:104: 00000100:00100000:2.0:1789601299.487275:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789601299.487308:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc29c5800/0xf3d6e402158abc3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abc38 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.487316:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edc29c5800/0xf3d6e402158abc3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abc38 expref: 12 pid: 5831 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601299.487323:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c82a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876532880479360:0@lo:104: 00000100:00100000:2.0:1789601299.487344:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601299.487356:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede0371300 going to sleep for 11 seconds 00000100:00100000:1.0:1789601299.487544:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880479104 00000100:00100000:1.0:1789601299.487555:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880479104 00000100:00100000:1.0:1789601299.487604:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880479232 00000100:00100000:1.0:1789601299.487608:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880479232 00000100:00100000:1.0:1789601299.487621:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880479360 00000100:00100000:1.0:1789601299.487624:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880479360 00000100:00100000:1.0:1789601299.487641:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601299.487652:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+5:5832:x1876532880479104:12345-0@lo:104: 00010000:00010000:1.0:1789601299.487674:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abcc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abccb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.487766:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789601299.487774:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+5:5832:x1876532880479104:12345-0@lo:104: Request processed in 124us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601299.487781:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601299.487801:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601299.487807:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+4:5832:x1876532880479232:12345-0@lo:104: 00010000:00010000:1.0:1789601299.487815:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abc54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abc5b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.487828:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601299.487861:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abcc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abccb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.487871:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4400 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:0.0:1789601299.487875:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abcc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abccb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.487900:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abcc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abccb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601299.487909:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abcc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abccb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601299.487916:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789601299.487957:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abcc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abccb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.487965:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601299.487993:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abcc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abccb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.488001:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abcc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abccb expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.488017:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601299.488020:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601299.488026:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601299.488053:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880479488:0@lo:103: 00010000:00010000:1.0:1789601299.488078:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789601299.488099:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601299.488100:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+4:5832:x1876532880479232:12345-0@lo:104: Request processed in 284us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601299.488117:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601299.488166:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789601299.488170:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880479488 00000100:00100000:0.0:1789601299.488177:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880479488 00000100:00100000:1.0:1789601299.488184:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:5832:x1876532880479360:12345-0@lo:104: 00010000:00010000:1.0:1789601299.488206:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abc38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abc3f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.488219:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ee02045400/0xf3d6e402158abccb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abcc4 expref: 13 pid: 5832 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.488276:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789601299.488284:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:5832:x1876532880479360:12345-0@lo:104: Request processed in 110us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601299.488289:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789601299.488331:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789601299.488337:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abc54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abc5b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.488365:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88800 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601299.488369:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abc54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abc5b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.488378:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abc54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abc5b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601299.488385:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abc54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abc5b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601299.488390:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789601299.488429:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789601299.488441:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abc54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abc5b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601299.488442:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:3319:x1876532880479488:12345-0@lo:103: 00010000:00010000:1.0:1789601299.488463:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601299.488469:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601299.488478:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ee02045400/0xf3d6e402158abccb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abcc4 expref: 13 pid: 5832 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.488488:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abc54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abc5b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.488495:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ee02045400/0xf3d6e402158abccb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abcc4 expref: 13 pid: 5832 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.488506:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abc54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abc5b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.488525:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789601299.488530:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601299.488535:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abc38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abc3f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.488542:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89e00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601299.488546:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abc38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abc3f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601299.488566:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:3319:x1876532880479488:12345-0@lo:103: Request processed in 125us (467us total) trans 0 rc 0/0 00010000:00010000:1.0:1789601299.488571:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abc38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abc3f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601299.488579:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 10000000:00010000:1.0:1789601299.488592:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abc38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abc3f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601299.488598:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601299.488623:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abc38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abc3f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601299.488627:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880479616:0@lo:103: 00010000:00010000:1.0:1789601299.488646:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601299.488670:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abc38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abc3f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601299.488684:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789601299.488695:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abc38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abc3f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.488718:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601299.488723:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601299.488726:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601299.488735:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880479744:0@lo:103: 00000100:00100000:0.0:1789601299.488779:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601299.488863:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880479488:0@lo:103: 00010000:00010000:1.0:1789601299.488901:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601299.489154:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ee02045400/0xf3d6e402158abccb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abcc4 expref: 12 pid: 5832 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601299.489169:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d93100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876532880479104:0@lo:104: 00000100:00100000:2.0:1789601299.489181:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c82d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876532880479232:0@lo:104: 00000100:00100000:2.0:1789601299.489191:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c82a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876532880479360:0@lo:104: 00010000:00010000:2.0:1789601299.489216:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd26 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601299.489255:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880479616 00000100:00100000:1.0:1789601299.489264:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880479616 00010000:00010000:1.0:1789601299.489296:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abc5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abc54 expref: 12 pid: 5831 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601299.489340:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880479744 00000100:00100000:1.0:1789601299.489343:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880479744 00000100:00100000:2.0:1789601299.489415:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789601299.489426:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:3320:x1876532880479616:12345-0@lo:103: 00010000:00010000:2.0:1789601299.489439:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601299.489445:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abc5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abc54 expref: 12 pid: 5831 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.489457:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abc5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abc54 expref: 12 pid: 5831 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.489472:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abc5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abc54 expref: 12 pid: 5831 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.489484:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601299.489594:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:3320:x1876532880479616:12345-0@lo:103: Request processed in 170us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601299.489601:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789601299.490247:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc29c5800/0xf3d6e402158abc3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abc38 expref: 11 pid: 5831 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601299.490292:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789601299.490301:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:3317:x1876532880479744:12345-0@lo:103: 00010000:00010000:1.0:1789601299.490316:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601299.490321:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc29c5800/0xf3d6e402158abc3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abc38 expref: 11 pid: 5831 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.490334:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc29c5800/0xf3d6e402158abc3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abc38 expref: 11 pid: 5831 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.490354:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc29c5800/0xf3d6e402158abc3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abc38 expref: 11 pid: 5831 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.490374:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd26 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.490384:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd26 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.490404:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.490411:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.490418:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd26 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.490425:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.490442:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030a00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601299.490447:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.490456:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd26 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.490470:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd26 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.490483:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601299.490554:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+10:3317:x1876532880479744:12345-0@lo:103: Request processed in 255us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601299.490561:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789601299.490632:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880479744:0@lo:103: 00010000:00010000:2.0:1789601299.491057:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.491068:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.491084:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd26 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789601299.491101:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789601299.499635:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880479616:0@lo:103: 00000100:00100000:0.0:1789601299.637241:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+9:6674:x1876532880478976:12345-0@lo:253: Request processed in 196741us (198657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601299.637262:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789601299.637481:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8deb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880478976:0@lo:253: 10000000:01000000:3.0:1789601299.637503:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789601299.637507:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789601299.637509:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789601299.637511:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789601299.637512:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789601299.637533:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789601299.637535:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789601299.637537:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789601299.637538:0:6674:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789601299.637540:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789601299.637542:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789601299.637571:0:6674:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91edc825a800 from lustre-OST0000 10000000:01000000:3.0:1789601299.637605:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789601299.637608:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789601299.637617:0:6674:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91edc6010000 local copy 10000000:01000000:3.0:1789601299.637623:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789601299.637677:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abd2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.637691:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abd2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.637702:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abd2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601299.637725:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8deb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880479872:0@lo:101: 00000100:00100000:3.0:1789601299.637780:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601299.638039:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf223c240 going to sleep for 11 seconds 00000100:00100000:1.0:1789601299.640609:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880479872 00000100:00100000:1.0:1789601299.640633:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880479872 00000100:00100000:1.0:1789601299.640729:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789601299.640753:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+9:6674:x1876532880479872:12345-0@lo:101: 00010000:00010000:1.0:1789601299.640780:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601299.640809:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc3b89e00/0xf3d6e402158abd34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abd2d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.640865:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc3b89e00/0xf3d6e402158abd34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abd2d expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.640890:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc3b89e00/0xf3d6e402158abd34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abd2d expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.640935:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b89e00, rc 0) 00000100:00100000:1.0:1789601299.641052:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+10:6674:x1876532880479872:12345-0@lo:101: Request processed in 311us (3270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601299.641058:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789601299.641479:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8deb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880479872:0@lo:101: 00010000:00010000:2.0:1789601299.641503:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abd2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf3d6e402158abd34 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.641514:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abd2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf3d6e402158abd34 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601299.641714:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880480000:0@lo:501: 00000100:00100000:2.0:1789601299.641774:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601299.641819:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc57d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789601299.642087:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880480000 00000100:00100000:0.0:1789601299.642094:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880480000 00000100:00100000:0.0:1789601299.642144:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789601299.642153:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+10:6674:x1876532880480000:12345-0@lo:501: 00000100:00100000:0.0:1789601299.642453:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+10:6674:x1876532880480000:12345-0@lo:501: Request processed in 301us (679us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789601299.642468:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789601299.642614:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880480000:0@lo:501: 10000000:01000000:2.0:1789601299.642634:0:6674:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789601299.642668:0:6674:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789601299.642676:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abd2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf3d6e402158abd34 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.642686:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abd2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf3d6e402158abd34 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.642694:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abd2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf3d6e402158abd34 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.642726:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789601299.642771:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91edc825a800 10000000:01000000:2.0:1789601299.642777:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789601299.642784:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff91edc6010000 10000000:01000000:2.0:1789601299.642786:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789601299.642790:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff91edc6010000 from 1 10000000:01000000:2.0:1789601299.642793:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789601299.642826:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4c00/0xf3d6e402158abd3b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.642870:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc29c4c00/0xf3d6e402158abd3b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.642882:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc29c4c00/0xf3d6e402158abd3b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601299.642901:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880480128:0@lo:101: 00000100:00100000:2.0:1789601299.642948:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601299.642977:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc57d840 going to sleep for 11 seconds 00000100:00100000:3.0:1789601299.643120:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880480128 00000100:00100000:3.0:1789601299.643126:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880480128 00000100:00100000:3.0:1789601299.643157:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789601299.643164:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+10:6674:x1876532880480128:12345-0@lo:101: 00010000:00010000:3.0:1789601299.643174:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601299.643190:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ee02044c00/0xf3d6e402158abd42 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abd3b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.643214:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ee02044c00/0xf3d6e402158abd42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abd3b expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.643233:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ee02044c00/0xf3d6e402158abd42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abd3b expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.643241:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee02044c00, rc 0) 00000100:00100000:3.0:1789601299.643296:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:6674:x1876532880480128:12345-0@lo:101: Request processed in 133us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601299.643303:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1789601299.643518:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601299.643526:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abd2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf3d6e402158abd34 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.643533:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee02045000 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:0.0:1789601299.643538:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abd2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf3d6e402158abd34 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.643546:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abd2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf3d6e402158abd34 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601299.643553:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abd2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf3d6e402158abd34 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601299.643559:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789601299.643584:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abd2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf3d6e402158abd34 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.643591:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601299.643620:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abd2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf3d6e402158abd34 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.643628:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abd2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf3d6e402158abd34 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.643650:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601299.643653:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601299.643654:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601299.643733:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880480128:0@lo:101: 00010000:00010000:2.0:1789601299.643758:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc29c4c00/0xf3d6e402158abd3b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abd42 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.643768:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc29c4c00/0xf3d6e402158abd3b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abd42 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601299.643790:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789601299.643809:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4c00/0xf3d6e402158abd3b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abd42 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.643818:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc29c4c00/0xf3d6e402158abd3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abd42 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601299.643874:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789601299.643880:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789601299.643887:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789601299.643890:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789601299.643908:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abd49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.644140:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abd49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.644149:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abd49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601299.644166:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880480384:0@lo:101: 00000100:00100000:2.0:1789601299.644213:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601299.644247:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc57d840 going to sleep for 11 seconds 00000100:00100000:1.0:1789601299.644408:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601299.644423:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880480256:0@lo:103: 00000100:00100000:1.0:1789601299.644457:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601299.644502:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880480384 00000100:00100000:1.0:1789601299.644508:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880480384 00000100:00100000:1.0:1789601299.644543:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789601299.644552:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:6674:x1876532880480384:12345-0@lo:101: 00010000:00010000:1.0:1789601299.644563:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601299.644578:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc3b88800/0xf3d6e402158abd50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abd49 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.644599:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc3b88800/0xf3d6e402158abd50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abd49 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.644608:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc3b88800/0xf3d6e402158abd50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abd49 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.644615:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88800, rc 0) 00000100:00100000:1.0:1789601299.644647:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:6674:x1876532880480384:12345-0@lo:101: Request processed in 96us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601299.644652:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789601299.645097:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880480384:0@lo:101: 00010000:00010000:2.0:1789601299.645111:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abd49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abd50 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.645122:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abd49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abd50 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601299.645267:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880480512:0@lo:501: 00000100:00100000:2.0:1789601299.645319:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601299.645355:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc57d840 going to sleep for 11 seconds 00000100:00100000:2.0:1789601299.645377:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880480256 00000100:00100000:2.0:1789601299.645399:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880480256 00000100:00100000:2.0:1789601299.645449:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789601299.645456:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:3317:x1876532880480256:12345-0@lo:103: 00010000:00010000:2.0:1789601299.645468:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601299.645486:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc3b89e00/0xf3d6e402158abd34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3d6e402158abd2d expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.645500:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601299.645535:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:3317:x1876532880480256:12345-0@lo:103: Request processed in 80us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601299.645542:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789601299.645742:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880480512 00000100:00100000:3.0:1789601299.645757:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880480512 00000100:00100000:3.0:1789601299.645793:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789601299.645801:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:6674:x1876532880480512:12345-0@lo:501: 00000100:00100000:3.0:1789601299.646260:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:6674:x1876532880480512:12345-0@lo:501: Request processed in 460us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601299.646267:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789601299.646420:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880480256:0@lo:103: 00000100:00100000:2.0:1789601299.646601:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880480512:0@lo:501: 00000100:00100000:2.0:1789601299.646644:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880480640:0@lo:503: 00000100:00100000:2.0:1789601299.646696:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601299.646735:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc57d840 going to sleep for 11 seconds 00000100:00100000:3.0:1789601299.647138:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880480640 00000100:00100000:3.0:1789601299.647145:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880480640 00000100:00100000:3.0:1789601299.647602:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789601299.647631:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:6674:x1876532880480640:12345-0@lo:503: 00000100:00100000:3.0:1789601299.648859:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:6674:x1876532880480640:12345-0@lo:503: Request processed in 1220us (2138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601299.648879:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789601299.653551:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880480640:0@lo:503: 00000040:00080000:2.0:1789601299.654111:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789601299.654235:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880480768:0@lo:502: 00000100:00100000:2.0:1789601299.654334:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601299.658237:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc57d840 going to sleep for 11 seconds 00000100:00100000:0.0:1789601299.659346:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880480768 00000100:00100000:0.0:1789601299.659387:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880480768 00000100:00100000:1.0:1789601299.662370:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789601299.662403:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:6674:x1876532880480768:12345-0@lo:502: 00000100:00100000:1.0:1789601299.662800:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:6674:x1876532880480768:12345-0@lo:502: Request processed in 400us (8466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601299.662809:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789601299.668283:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880480768:0@lo:502: 00000040:00080000:2.0:1789601299.668722:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789601299.668823:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789601299.672368:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789601299.672573:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789601299.672617:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789601299.672653:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789601299.672726:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8deb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880480896:0@lo:502: 00000100:00100000:3.0:1789601299.673431:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601299.673572:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc2d61a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789601299.680594:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880480896 00000100:00100000:1.0:1789601299.680615:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880480896 00000100:00100000:1.0:1789601299.680777:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789601299.680791:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:6674:x1876532880480896:12345-0@lo:502: 00000100:00100000:1.0:1789601299.681528:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:6674:x1876532880480896:12345-0@lo:502: Request processed in 736us (8095us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601299.681539:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789601299.685327:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8deb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880480896:0@lo:502: 00000040:00080000:2.0:1789601299.685641:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789601299.685668:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1789601299.686805:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789601299.686818:0:6693:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789601299.686827:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601299.686830:0:6693:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789601299.686878:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789601299.686903:0:6693:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff91edc6054d40) 00000020:00000080:3.0:1789601299.686948:0:6693:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789601299.686957:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789601299.687067:0:6693:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91edc825a800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789601299.687077:0:6693:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789601299.687086:0:6693:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf3d6e402158abd5e 00010000:00010000:3.0:1789601299.694153:0:6693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1789601299.694607:0:6693:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1789601299.701206:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789601299.701633:0:6693:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1789601299.716251:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789601299.720667:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789601299.729202:0:6693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789601299.729221:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601299.729229:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601299.729232:0:6693:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789601299.729236:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601299.729241:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601299.729242:0:6693:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789601299.729246:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789601299.729248:0:6693:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789601299.729335:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601299.729339:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601299.729341:0:6693:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789601299.729345:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789601299.729832:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1789601299.729900:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789601299.729939:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abd49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abd50 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.729955:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abd49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abd50 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601299.729966:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91edc825a800 from 1 10000000:01000000:2.0:1789601299.729969:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789601299.730025:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5800/0xf3d6e402158abd65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.730034:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc29c5800/0xf3d6e402158abd65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.730048:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc29c5800/0xf3d6e402158abd65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601299.730081:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880481024:0@lo:101: 00000100:00100000:2.0:1789601299.730186:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601299.730250:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc57d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789601299.730393:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880481024 00000100:00100000:1.0:1789601299.730404:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880481024 00000100:00100000:1.0:1789601299.730468:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789601299.730481:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:6674:x1876532880481024:12345-0@lo:101: 00010000:00010000:1.0:1789601299.730498:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601299.730513:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158abd6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abd65 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.730542:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158abd6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abd65 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.730555:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158abd6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abd65 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.730565:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88a00, rc 0) 00000100:00100000:1.0:1789601299.730616:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:6674:x1876532880481024:12345-0@lo:101: Request processed in 138us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601299.730638:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789601299.730703:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c82a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880481024:0@lo:101: 00010000:00010000:1.0:1789601299.730719:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc29c5800/0xf3d6e402158abd65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abd6c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.730728:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc29c5800/0xf3d6e402158abd65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abd6c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601299.730888:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880481152:0@lo:501: 00000100:00100000:1.0:1789601299.730933:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601299.730958:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc702f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789601299.730977:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880481152 00000100:00100000:1.0:1789601299.730981:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880481152 00000100:00100000:1.0:1789601299.731005:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789601299.731011:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:6674:x1876532880481152:12345-0@lo:501: 00000100:00100000:1.0:1789601299.731285:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:6674:x1876532880481152:12345-0@lo:501: Request processed in 272us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601299.731293:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789601299.731329:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880481152:0@lo:501: 00000100:00100000:1.0:1789601299.731362:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880481280:0@lo:503: 00000100:00100000:1.0:1789601299.731403:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601299.731417:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc702f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789601299.731430:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880481280 00000100:00100000:1.0:1789601299.731434:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880481280 00000100:00100000:1.0:1789601299.731450:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789601299.731456:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:6674:x1876532880481280:12345-0@lo:503: 00000100:00100000:1.0:1789601299.731626:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:6674:x1876532880481280:12345-0@lo:503: Request processed in 169us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601299.731633:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789601299.731669:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880481280:0@lo:503: 00000040:00080000:1.0:1789601299.732038:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789601299.732146:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880481408:0@lo:502: 00000100:00100000:1.0:1789601299.732188:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601299.732209:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc702f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789601299.732229:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880481408 00000100:00100000:1.0:1789601299.732235:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880481408 00000100:00100000:1.0:1789601299.732255:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789601299.732261:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:6674:x1876532880481408:12345-0@lo:502: 00000100:00100000:1.0:1789601299.732434:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:6674:x1876532880481408:12345-0@lo:502: Request processed in 172us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601299.732441:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789601299.732481:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880481408:0@lo:502: 00000040:00080000:1.0:1789601299.732722:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789601299.732786:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789601299.732809:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880481536:0@lo:502: 00000100:00100000:1.0:1789601299.732869:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601299.732886:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc702f900 going to sleep for 11 seconds 00000100:00100000:1.0:1789601299.732901:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880481536 00000100:00100000:1.0:1789601299.732904:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880481536 00000100:00100000:1.0:1789601299.732922:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789601299.732927:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:6674:x1876532880481536:12345-0@lo:502: 00000100:00100000:1.0:1789601299.733043:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:6674:x1876532880481536:12345-0@lo:502: Request processed in 115us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601299.733056:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789601299.733089:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880481536:0@lo:502: 00000040:00080000:1.0:1789601299.733154:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789601299.733163:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789601299.733492:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601299.733505:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601299.733508:0:6696:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789601299.733515:0:6696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91edc825a800 00000020:00000080:1.0:1789601299.733518:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789601299.733541:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601299.733543:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601299.733545:0:6696:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789601299.733547:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789601299.733574:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789601299.733592:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789601299.733607:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5800/0xf3d6e402158abd65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abd6c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.733620:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc29c5800/0xf3d6e402158abd65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abd6c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601299.733664:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789601299.733668:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91edc825a800 10000000:01000000:1.0:1789601299.733671:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91edc825a800 10000000:01000000:1.0:1789601299.733676:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789601299.733683:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91edc825a800 from 1 10000000:01000000:1.0:1789601299.733686:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789601299.733718:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abd73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.733739:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abd73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601299.741224:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abd73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601299.741268:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880481664:0@lo:101: 00000100:00100000:1.0:1789601299.741381:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601299.742162:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc702fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601299.751813:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880481664 00000100:00100000:2.0:1789601299.751852:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880481664 00000100:00100000:2.0:1789601299.751974:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789601299.751988:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:6674:x1876532880481664:12345-0@lo:101: 00010000:00010000:2.0:1789601299.752012:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601299.752037:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc29c5a00/0xf3d6e402158abd7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abd73 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.752106:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c5a00/0xf3d6e402158abd7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abd73 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.752119:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc29c5a00/0xf3d6e402158abd7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abd73 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.752131:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c5a00, rc 0) 00000100:00100000:2.0:1789601299.752254:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:6674:x1876532880481664:12345-0@lo:101: Request processed in 269us (10873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601299.752261:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789601299.753281:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880481664:0@lo:101: 00010000:00010000:0.0:1789601299.753308:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abd73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abd7a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.753320:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abd73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abd7a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601299.753517:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880481792:0@lo:501: 00000100:00100000:0.0:1789601299.753587:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601299.753638:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc7951e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789601299.755925:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880481792 00000100:00100000:2.0:1789601299.755949:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880481792 00000100:00100000:2.0:1789601299.756049:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789601299.756063:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:6674:x1876532880481792:12345-0@lo:501: 00000100:00100000:2.0:1789601299.756530:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:6674:x1876532880481792:12345-0@lo:501: Request processed in 469us (2942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601299.756538:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789601299.759805:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880481792:0@lo:501: 00000100:00100000:0.0:1789601299.759927:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880481920:0@lo:503: 00000100:00100000:0.0:1789601299.760045:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601299.760101:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc7951e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789601299.760130:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880481920 00000100:00100000:0.0:1789601299.760138:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880481920 00000100:00100000:0.0:1789601299.760196:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789601299.760206:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:6674:x1876532880481920:12345-0@lo:503: 00000100:00100000:0.0:1789601299.760440:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:6674:x1876532880481920:12345-0@lo:503: Request processed in 234us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601299.760448:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789601299.760509:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880481920:0@lo:503: 00000040:00080000:0.0:1789601299.760930:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789601299.761017:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880482048:0@lo:502: 00000100:00100000:0.0:1789601299.761060:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601299.761086:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc7951e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789601299.761106:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880482048 00000100:00100000:0.0:1789601299.761110:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880482048 00000100:00100000:0.0:1789601299.761136:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789601299.761141:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:6674:x1876532880482048:12345-0@lo:502: 00000100:00100000:0.0:1789601299.761303:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:6674:x1876532880482048:12345-0@lo:502: Request processed in 161us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601299.761310:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789601299.761353:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880482048:0@lo:502: 00000040:00080000:0.0:1789601299.761633:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789601299.761680:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789601299.761713:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789601299.761788:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789601299.761828:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789601299.761913:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789601299.761951:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789601299.761982:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789601299.762026:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789601299.762063:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789601299.762096:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789601299.762143:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789601299.762195:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789601299.762229:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789601299.762274:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789601299.762307:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789601299.762335:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789601299.762378:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789601299.762410:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789601299.762441:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789601299.762489:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789601299.762526:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789601299.762572:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789601299.762622:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789601299.762658:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789601299.762691:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789601299.780830:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789601299.781044:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1789601299.781122:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880482176:0@lo:502: 00000100:00100000:2.0:1789601299.781255:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601299.781321:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc57d300 going to sleep for 11 seconds 00000100:00100000:0.0:1789601299.781543:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880482176 00000100:00100000:0.0:1789601299.781552:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880482176 00000100:00100000:0.0:1789601299.781625:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789601299.781636:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:6674:x1876532880482176:12345-0@lo:502: 00000100:00100000:0.0:1789601299.782075:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:6674:x1876532880482176:12345-0@lo:502: Request processed in 439us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601299.782085:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789601299.782764:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c82d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880482176:0@lo:502: 00000040:00080000:2.0:1789601299.783172:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789601299.783195:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789601299.792525:0:6698:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789601299.792549:0:6698:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff91edc71ccd40) 00000020:00000080:0.0:1789601299.792575:0:6698:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789601299.792671:0:6698:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91edc825a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789601299.792677:0:6698:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91edc825a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789601299.792680:0:6698:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91edc825a800 3 00010000:00080000:0.0:1789601299.792720:0:6698:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91edffe98800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.130@tcp at head 00010000:00010000:0.0:1789601299.801373:0:6698:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1789601299.801637:0:6698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789601299.801684:0:6698:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789601299.801697:0:6698:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf3d6e402158abd88 00000100:00080000:0.0:1789601299.803824:0:6698:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789601299.803932:0:6698:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91edffe98800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1789601299.803977:0:6698:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91edd8d90a80 x1876532880482304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789601299.804958:0:6698:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789601299.806013:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601299.806041:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880482432:0@lo:400: 00000100:00100000:3.0:1789601299.806135:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601299.806558:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1876532880482304:0@lo:38: 00000100:00100000:1.0:1789601299.806605:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601299.806874:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880482432 00000100:00100000:1.0:1789601299.806885:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880482432 00000100:00100000:1.0:1789601299.806964:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880482304 00000100:00100000:1.0:1789601299.806968:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880482304 00000100:00100000:1.0:1789601299.806988:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601299.807000:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880482432:12345-0@lo:400: 00000100:00100000:1.0:1789601299.807081:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880482432:12345-0@lo:400: Request processed in 82us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601299.807088:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601299.807110:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601299.807116:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3316:x1876532880482304:12345-0@lo:38: 00010000:00080000:1.0:1789601299.807146:0:5839:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:1.0:1789601299.807197:0:5839:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf3d6e402158abd8f 00000004:00100000:1.0:1789601299.807219:0:5839:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789601299.807264:0:5839:0:(import.c:65:import_set_state_nolock()) ffff91edffe43000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789601299.807336:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876532880482304:12345-0@lo:38: Request processed in 219us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601299.807343:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789601299.807427:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91edd8de9180 x1876532880482432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601299.807446:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8de9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880482432:0@lo:400: 00000040:00080000:2.0:1789601299.810139:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:0.0:1789601299.811426:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91edd8d90a80 x1876532880482304/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789601309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601299.811457:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789601299.811470:0:3316:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789601299.811480:0:3316:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789601299.811486:0:3316:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789601299.811490:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91edffe98800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789601299.811497:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1876532880482304:0@lo:38: 00000020:01000000:0.0:1789601299.814156:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789601299.814198:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789601299.814270:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abd73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abd7a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.814284:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abd73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abd7a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789601299.814361:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789601299.814364:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789601299.814365:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601299.814367:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601299.814368:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601299.814370:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601299.814371:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789601299.814373:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789601299.814374:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789601299.814376:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601299.814377:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789601299.814381:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789601299.814383:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789601299.814385:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789601299.814386:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601299.814387:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601299.814388:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601299.814389:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601299.814398:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789601299.814399:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789601299.814400:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789601299.814401:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601299.814402:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789601299.814433:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789601299.814454:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880482560:0@lo:253: 00000100:00100000:0.0:1789601299.814537:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601299.814589:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8f1d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789601299.815195:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880482560 00000100:00100000:3.0:1789601299.815214:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880482560 00000100:00100000:3.0:1789601299.815298:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789601299.815317:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:6674:x1876532880482560:12345-0@lo:253: 20000000:01000000:3.0:1789601299.815361:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789601299.815384:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789601299.906582:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789601299.906678:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789601299.912319:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789601299.912375:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789601299.912401:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.912421:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc0031c00/0xf3d6e402158abcf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abcee expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.912429:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd96 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.912473:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc0031c00/0xf3d6e402158abcf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abcee expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601299.912485:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edc0031c00/0xf3d6e402158abcf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abcee expref: 13 pid: 5832 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601299.912498:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d90e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1876532880482688:0@lo:104: 00000100:00100000:0.0:1789601299.912564:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601299.912628:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8f1db40 going to sleep for 11 seconds 00000100:00100000:2.0:1789601299.913480:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:6674:x1876532880482560:12345-0@lo:253: Request processed in 98166us (98941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601299.913491:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789601299.913642:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d90a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:6674:1876532880482560:0@lo:253: 10000000:01000000:0.0:1789601299.913655:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789601299.913658:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789601299.913672:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789601299.913673:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601299.913675:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601299.913676:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601299.913678:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601299.913680:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789601299.913682:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789601299.913683:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789601299.913685:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601299.913686:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789601299.913700:0:6674:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789601299.913966:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880482688 00000100:00100000:3.0:1789601299.913975:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880482688 00000100:00100000:3.0:1789601299.914142:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789601299.914152:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:5853:x1876532880482688:12345-0@lo:104: 00010000:00010000:3.0:1789601299.914168:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abcee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abcf5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.914234:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789601299.914240:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:5853:x1876532880482688:12345-0@lo:104: Request processed in 91us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601299.914247:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789601299.914265:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601299.914271:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abcee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abcf5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.914279:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee02045c00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:3.0:1789601299.914284:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abcee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abcf5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.914293:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abcee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abcf5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601299.914309:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abcee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abcf5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601299.914316:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789601299.914351:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abcee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abcf5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.914358:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789601299.914377:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abcee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abcf5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.914386:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abcee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abcf5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.914405:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601299.914407:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601299.914409:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601299.914422:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880482816:0@lo:103: 00000100:00100000:3.0:1789601299.914461:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601299.914505:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880482816 00000100:00100000:3.0:1789601299.914509:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880482816 00010000:00010000:3.0:1789601299.914527:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc0031c00/0xf3d6e402158abcf5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abcee expref: 13 pid: 5832 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601299.914551:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789601299.914558:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2225850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:3320:x1876532880482816:12345-0@lo:103: 00010000:00010000:3.0:1789601299.914570:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601299.914575:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc0031c00/0xf3d6e402158abcf5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abcee expref: 13 pid: 5832 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.914592:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc0031c00/0xf3d6e402158abcf5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abcee expref: 13 pid: 5832 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.914610:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd96 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.914619:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789601299.914633:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002302336s 00010000:00010000:3.0:1789601299.914638:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.914646:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.914654:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.914661:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.914668:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030a00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601299.914672:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.914680:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd96 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.914690:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd96 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601299.914709:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601299.914738:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2225850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:3320:x1876532880482816:12345-0@lo:103: Request processed in 181us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601299.914757:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789601299.914825:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880482816:0@lo:103: 00010000:00010000:2.0:1789601299.920248:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc0031c00/0xf3d6e402158abcf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abcee expref: 12 pid: 5832 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601299.920272:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d90e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1876532880482688:0@lo:104: 00010000:00010000:2.0:1789601299.920298:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.920311:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.920317:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601299.920322:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abd96 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1789601299.922228:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789601299.922404:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789601299.922612:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789601299.924696:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789601299.925045:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789601299.925280:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789601299.926381:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789601300.165510:0:6674:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789601300.165516:0:6674:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789601300.165549:0:6674:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789601300.165608:0:6674:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789601300.165624:0:6674:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789601300.165650:0:6674:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789601300.489206:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601301.513428:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601302.537131:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601303.567001:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601304.585153:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601305.039464:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880482944:0@lo:400: 00000100:00100000:0.0:1789601305.039547:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601305.039602:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601305.039609:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880483072:0@lo:400: 00000100:00100000:0.0:1789601305.039634:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601305.039681:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880483200:0@lo:400: 00000100:00100000:0.0:1789601305.039707:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601305.039752:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880482944 00000100:00100000:0.0:1789601305.039761:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880482944 00000100:00100000:0.0:1789601305.039808:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789601305.039817:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:3317:x1876532880482944:12345-0@lo:400: 00000100:00100000:0.0:1789601305.039898:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:3317:x1876532880482944:12345-0@lo:400: Request processed in 82us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601305.039905:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789601305.039952:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880483072 00000100:00100000:0.0:1789601305.039955:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880483072 00000100:00100000:0.0:1789601305.039980:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880483200 00000100:00100000:0.0:1789601305.039983:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880483200 00000100:00100000:0.0:1789601305.040017:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789601305.040023:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880483072:12345-0@lo:400: 00000100:00100000:0.0:1789601305.040056:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880483072:12345-0@lo:400: Request processed in 33us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601305.040062:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789601305.040074:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789601305.040080:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880483200:12345-0@lo:400: 00000100:00100000:0.0:1789601305.040108:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880483200:12345-0@lo:400: Request processed in 29us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601305.040114:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789601305.040179:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edd8d93480 x1876532880483200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601305.040194:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880483200:0@lo:400: 00010000:00080000:0.0:1789601305.040224:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edd8d93800 x1876532880483072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601305.040233:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880483072:0@lo:400: 00000100:00100000:0.0:1789601305.040242:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880482944:0@lo:400: 00000100:00080000:3.0:1789601305.040579:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789601305.609211:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601306.637460:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789601307.082411:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789601307.082421:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91edd1466000 from 21 10000000:01000000:0.0:1789601307.082426:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789601307.082475:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abd9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601307.082504:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abd9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601307.082518:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abd9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601307.082545:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880483328:0@lo:101: 00000100:00100000:0.0:1789601307.082642:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601307.082694:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8968240 going to sleep for 11 seconds 00000100:00100000:2.0:1789601307.083483:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880483328 00000100:00100000:2.0:1789601307.083494:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880483328 00000100:00100000:2.0:1789601307.083592:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789601307.083603:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5834:x1876532880483328:12345-0@lo:101: 00010000:00010000:2.0:1789601307.083641:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601307.083657:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc29c4600/0xf3d6e402158abda4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abd9d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601307.083683:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c4600/0xf3d6e402158abda4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abd9d expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601307.083695:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc29c4600/0xf3d6e402158abda4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abd9d expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601307.083704:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c4600, rc 0) 00000100:00100000:2.0:1789601307.083770:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:5834:x1876532880483328:12345-0@lo:101: Request processed in 170us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601307.083777:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789601307.088577:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880483328:0@lo:101: 00010000:00010000:0.0:1789601307.088611:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abd9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abda4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601307.088638:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abd9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abda4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601307.088721:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880483456:0@lo:501: 00000100:00100000:0.0:1789601307.088791:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601307.088830:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8968240 going to sleep for 11 seconds 00000100:00100000:0.0:1789601307.088869:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880483456 00000100:00100000:0.0:1789601307.088876:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880483456 00000100:00100000:0.0:1789601307.088916:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789601307.088925:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:5834:x1876532880483456:12345-0@lo:501: 00000100:00100000:0.0:1789601307.089460:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:5834:x1876532880483456:12345-0@lo:501: Request processed in 533us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601307.089469:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789601307.089581:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880483456:0@lo:501: 00000100:00100000:3.0:1789601307.089630:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8de8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880483584:0@lo:503: 00000100:00100000:3.0:1789601307.089671:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601307.089692:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc63ff240 going to sleep for 11 seconds 00000100:00100000:0.0:1789601307.089742:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880483584 00000100:00100000:0.0:1789601307.089748:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880483584 00000100:00100000:0.0:1789601307.089803:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789601307.089810:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:5834:x1876532880483584:12345-0@lo:503: 00000100:00100000:0.0:1789601307.090103:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:5834:x1876532880483584:12345-0@lo:503: Request processed in 293us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601307.090110:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789601307.090147:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8de8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880483584:0@lo:503: 00000100:00100000:0.0:1789601307.090386:0:7004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:7004:1876532880483712:0@lo:502: 00000100:00100000:0.0:1789601307.090421:0:7004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601307.090438:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880483712 00000100:00100000:0.0:1789601307.090442:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880483712 00000100:00100000:0.0:1789601307.090457:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789601307.090463:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7004:x1876532880483712:12345-0@lo:502: 00000100:00100000:0.0:1789601307.090637:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7004:x1876532880483712:12345-0@lo:502: Request processed in 174us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601307.090644:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789601307.090681:0:7004:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8968cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601307.090694:0:7004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:7004:1876532880483712:0@lo:502: 00000100:00100000:0.0:1789601307.090732:0:7004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:7004:1876532880483840:0@lo:502: 00000100:00100000:0.0:1789601307.090762:0:7004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601307.090780:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880483840 00000100:00100000:0.0:1789601307.090785:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880483840 00000100:00100000:0.0:1789601307.090799:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789601307.090805:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7004:x1876532880483840:12345-0@lo:502: 00000100:00100000:0.0:1789601307.090938:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7004:x1876532880483840:12345-0@lo:502: Request processed in 131us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601307.090950:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789601307.090977:0:7004:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8968cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601307.090987:0:7004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:7004:1876532880483840:0@lo:502: 00000040:00080000:0.0:1789601307.091004:0:7004:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789601307.091048:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789601307.091063:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789601307.091073:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abd9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abda4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601307.091083:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abd9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abda4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601307.091093:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789601307.091096:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91edd1466000 from 4 10000000:01000000:0.0:1789601307.091098:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789601307.091121:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc0031400/0xf3d6e402158abdab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601307.091128:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc0031400/0xf3d6e402158abdab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601307.091138:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc0031400/0xf3d6e402158abdab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601307.091149:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880483968:0@lo:101: 00000100:00100000:0.0:1789601307.091172:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601307.091185:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8968cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601307.091195:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880483968 00000100:00100000:0.0:1789601307.091198:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880483968 00000100:00100000:0.0:1789601307.091220:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789601307.091225:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:5834:x1876532880483968:12345-0@lo:101: 00010000:00010000:0.0:1789601307.091232:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601307.091243:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abdb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abdab expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601307.091262:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abdb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abdab expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601307.091270:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abdb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abdab expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601307.091278:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc0030a00, rc 0) 00000100:00100000:0.0:1789601307.092485:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:5834:x1876532880483968:12345-0@lo:101: Request processed in 1252us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601307.092496:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789601307.098378:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d93800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880483968:0@lo:101: 00010000:00010000:2.0:1789601307.098410:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc0031400/0xf3d6e402158abdab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abdb2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601307.098426:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc0031400/0xf3d6e402158abdab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abdb2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601307.098650:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8de8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880484096:0@lo:256: 00000100:00100000:3.0:1789601307.098724:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601307.098767:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc63ffd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601307.098867:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880484096 00000100:00100000:2.0:1789601307.098876:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880484096 00000100:00100000:2.0:1789601307.098918:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789601307.098928:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:5834:x1876532880484096:12345-0@lo:256: 20000000:01000000:2.0:1789601307.098947:0:5832:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789601307.098963:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789601307.098966:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789601307.099061:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:5834:x1876532880484096:12345-0@lo:256: Request processed in 134us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601307.099076:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789601307.099120:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8de8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880484096:0@lo:256: 10000000:01000000:2.0:1789601307.099162:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789601307.099169:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc0031400/0xf3d6e402158abdab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abdb2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601307.099177:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc0031400/0xf3d6e402158abdab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abdb2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601307.099187:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789601307.099189:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789601307.099192:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789601307.099218:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abdb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601307.099226:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abdb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601307.099236:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abdb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601307.099248:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880484224:0@lo:101: 00000100:00100000:2.0:1789601307.099272:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601307.099380:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880484224 00000100:00100000:3.0:1789601307.099386:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880484224 00000100:00100000:3.0:1789601307.099409:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789601307.099415:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:5834:x1876532880484224:12345-0@lo:101: 00010000:00010000:3.0:1789601307.099424:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601307.099436:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abdc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abdb9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601307.099456:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abdc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abdb9 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601307.099479:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abdc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abdb9 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601307.099488:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee02045a00, rc 0) 00000100:00100000:3.0:1789601307.099512:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:5834:x1876532880484224:12345-0@lo:101: Request processed in 97us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601307.099518:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789601307.099570:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8095840 going to sleep for 11 seconds 00000100:00100000:2.0:1789601307.099583:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880484224:0@lo:101: 00010000:00010000:2.0:1789601307.099594:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abdb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abdc0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601307.099622:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abdb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abdc0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601307.099670:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880484352:0@lo:501: 00000100:00100000:2.0:1789601307.099695:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601307.099751:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8095840 going to sleep for 11 seconds 00000100:00100000:3.0:1789601307.099918:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880484352 00000100:00100000:3.0:1789601307.099923:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880484352 00000100:00100000:3.0:1789601307.099941:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789601307.099947:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:5834:x1876532880484352:12345-0@lo:501: 00000100:00100000:3.0:1789601307.100236:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:5834:x1876532880484352:12345-0@lo:501: Request processed in 288us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601307.100244:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789601307.105651:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c82d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880484352:0@lo:501: 00000100:00100000:0.0:1789601307.105725:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880484480:0@lo:503: 00000100:00100000:0.0:1789601307.105810:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601307.105871:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8968cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601307.105898:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880484480 00000100:00100000:0.0:1789601307.105905:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880484480 00000100:00100000:0.0:1789601307.105967:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789601307.105975:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:5834:x1876532880484480:12345-0@lo:503: 00000100:00100000:0.0:1789601307.106869:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:5834:x1876532880484480:12345-0@lo:503: Request processed in 891us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601307.106879:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789601307.106947:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d93480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880484480:0@lo:503: 00000100:00100000:0.0:1789601307.107155:0:7005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d93480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:7005:1876532880484608:0@lo:502: 00000100:00100000:0.0:1789601307.107198:0:7005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601307.107428:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880484608 00000100:00100000:0.0:1789601307.107435:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880484608 00000100:00100000:0.0:1789601307.107467:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789601307.107476:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:7005:x1876532880484608:12345-0@lo:502: 00000100:00100000:0.0:1789601307.107751:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:7005:x1876532880484608:12345-0@lo:502: Request processed in 276us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601307.107758:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789601307.107794:0:7005:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc702f000 going to sleep for 11 seconds 00000100:00100000:0.0:1789601307.107810:0:7005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d93480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:7005:1876532880484608:0@lo:502: 00000020:01000000:0.0:1789601307.107857:0:7005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789601307.107865:0:7005:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789601307.107871:0:7005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601307.107873:0:7005:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789601307.107878:0:7005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789601307.107881:0:7005:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:0.0:1789601307.107903:0:7005:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789601307.108198:0:7005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789601307.108428:0:7005:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff91edc71c8000) 00000020:00000080:0.0:1789601307.108453:0:7005:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789601307.108462:0:7005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789601307.108571:0:7005:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789601307.108577:0:7005:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789601307.108584:0:7005:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3d6e402158abdce 00010000:00080000:0.0:1789601307.108627:0:7005:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91edc7b4b800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:0.0:1789601307.109470:0:7005:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789601307.192064:0:7005:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789601307.192105:0:7005:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789601307.192931:0:7005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789601307.193104:0:7005:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789601307.193156:0:7005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789601307.194528:0:7005:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789601307.195643:0:7008:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789601307.195650:0:7008:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789601307.210777:0:7005:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789601307.210793:0:7005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789601307.210855:0:7005:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789601307.210881:0:7005:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3d6e402158abdd5 00000100:00080000:1.0:1789601307.210891:0:7005:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789601307.210903:0:7005:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91edc7b4b800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1789601307.210952:0:7005:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ee00c69180 x1876532880484736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789601307.210980:0:7005:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789601307.211036:0:7005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601307.211040:0:7005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601307.211042:0:7005:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789601307.211045:0:7005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601307.211048:0:7005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601307.211050:0:7005:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789601307.211053:0:7005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789601307.211054:0:7005:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789601307.211081:0:7005:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:7005:1876532880484864:0@lo:502: 00000100:00100000:1.0:1789601307.211169:0:7005:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601307.211283:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880484736:0@lo:8: 00000100:00100000:2.0:1789601307.211317:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601307.212948:0:7005:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc9604b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601307.213068:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880484864 00000100:00100000:1.0:1789601307.213077:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880484864 00000100:00100000:1.0:1789601307.213122:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789601307.213131:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:7005:x1876532880484864:12345-0@lo:502: 00000100:00100000:1.0:1789601307.213423:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:7005:x1876532880484864:12345-0@lo:502: Request processed in 293us (2253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601307.213430:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789601307.213468:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601307.213480:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880484992:0@lo:400: 00000100:00100000:1.0:1789601307.213509:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601307.213538:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880485120:0@lo:400: 00000100:00100000:1.0:1789601307.213555:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601307.213587:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880484992 00000100:00100000:1.0:1789601307.213590:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880484992 00000100:00100000:1.0:1789601307.213625:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880485120 00000100:00100000:1.0:1789601307.213629:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880485120 00000100:00100000:1.0:1789601307.213654:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789601307.213660:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880484992:12345-0@lo:400: 00000100:00100000:1.0:1789601307.213695:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880484992:12345-0@lo:400: Request processed in 35us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601307.213700:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789601307.213710:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789601307.213716:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880485120:12345-0@lo:400: 00000100:00100000:1.0:1789601307.213894:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880485120:12345-0@lo:400: Request processed in 178us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601307.213900:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789601307.213932:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789601307.213959:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ee00c68380 x1876532880485120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601307.213973:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880485120:0@lo:400: 00010000:00080000:1.0:1789601307.213994:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ee00c68000 x1876532880484992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601307.214002:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880484992:0@lo:400: 00000100:00100000:1.0:1789601307.214018:0:7005:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:7005:1876532880484864:0@lo:502: 00000020:01000000:1.0:1789601307.214044:0:7005:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601307.214050:0:7005:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601307.214052:0:7005:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789601307.214056:0:7005:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1789601307.214161:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789601307.214178:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789601307.214186:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abdb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abdc0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601307.214197:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abdb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abdc0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601307.214207:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789601307.214209:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91edc6010000 from 1 10000000:01000000:1.0:1789601307.214212:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:2.0:1789601307.214456:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880484736 00000100:00100000:2.0:1789601307.214463:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880484736 00000100:00100000:2.0:1789601307.214488:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789601307.214493:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3316:x1876532880484736:12345-0@lo:8: 00010000:00080000:2.0:1789601307.214516:0:6676:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:2.0:1789601307.214544:0:6676:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3d6e402158abddc 00002000:00100000:2.0:1789601307.214586:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff91edefeee800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789601307.214590:0:6676:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1789601307.214594:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789601307.214728:0:6676:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789601307.214903:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789601307.214931:0:6676:0:(import.c:65:import_set_state_nolock()) ffff91edefee8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789601307.214995:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1876532880484736:12345-0@lo:8: Request processed in 501us (3676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601307.215002:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789601307.215039:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ee00c69180 x1876532880484736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789601317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601307.215062:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789601307.215069:0:3316:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789601307.215076:0:3316:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789601307.215081:0:3316:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789601307.215084:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91edc7b4b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789601307.215098:0:3316:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789601307.215103:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880484736:0@lo:8: 00000004:00080000:2.0:1789601307.215124:0:7008:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00010000:1.0:1789601307.215432:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abde3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601307.215442:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abde3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601307.215462:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abde3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601307.215478:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880485248:0@lo:101: 00000100:00100000:1.0:1789601307.215517:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601307.215535:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd84b7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601307.215552:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880485248 00000100:00100000:1.0:1789601307.215557:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880485248 00000100:00100000:1.0:1789601307.215583:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789601307.215589:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:5834:x1876532880485248:12345-0@lo:101: 00010000:00010000:1.0:1789601307.215597:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601307.215622:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abdea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abde3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601307.215645:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abdea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abde3 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601307.215656:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abdea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abde3 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601307.215664:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88400, rc 0) 00000100:00100000:1.0:1789601307.215692:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:5834:x1876532880485248:12345-0@lo:101: Request processed in 104us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601307.215698:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:2.0:1789601307.215802:0:7008:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 177253964362ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789601307.216456:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880485248:0@lo:101: 00010000:00010000:1.0:1789601307.216474:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abde3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abdea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601307.216494:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abde3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abdea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601307.216551:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880485376:0@lo:501: 00000100:00100000:1.0:1789601307.216584:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601307.216607:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc9604cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601307.216632:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880485376 00000100:00100000:1.0:1789601307.216637:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880485376 00000100:00100000:1.0:1789601307.216702:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789601307.216710:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:5834:x1876532880485376:12345-0@lo:501: 00000100:00100000:1.0:1789601307.216929:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:5834:x1876532880485376:12345-0@lo:501: Request processed in 219us (343us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789601307.216937:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789601307.227973:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880485376:0@lo:501: 10000000:01000000:1.0:1789601307.228018:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789601307.228029:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abde3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abdea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601307.228039:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abde3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abdea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789601307.284331:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789601307.372974:0:7009:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789601307.373009:0:7009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8deb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7009:1876532880485632:0@lo:7: 00000100:00100000:0.0:1789601307.373234:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880485504:0@lo:13: 00000100:00100000:0.0:1789601307.381826:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601307.382200:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880485504 00000100:00100000:1.0:1789601307.382212:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880485504 00000100:00100000:1.0:1789601307.382274:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789601307.382284:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1876532880485504:12345-0@lo:13: 00002000:00000024:1.0:1789601307.382338:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789601307.382396:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1876532880485504:12345-0@lo:13: Request processed in 114us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601307.382404:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789601307.382470:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edd8de8380 x1876532880485504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601307.382491:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880485504:0@lo:13: 00000100:00080000:0.0:1789601307.382699:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601307.382988:0:7009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601307.383033:0:7009:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc63ff000 going to sleep for 11 seconds 00000100:00100000:1.0:1789601307.383381:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880485632 00000100:00100000:1.0:1789601307.383388:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880485632 00000100:00100000:1.0:1789601307.383417:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789601307.383437:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7009:x1876532880485632:12345-0@lo:7: 00002000:00080000:1.0:1789601307.402652:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1789601307.402661:0:6679:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789601307.402775:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7009:x1876532880485632:12345-0@lo:7: Request processed in 19335us (19784us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601307.402786:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789601307.402879:0:7009:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edd8deb100 x1876532880485632/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789601323 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601307.402895:0:7009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8deb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7009:1876532880485632:0@lo:7: 00000004:00080000:1.0:1789601307.402909:0:7009:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789601307.402949:0:7009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7009:1876532880485760:0@lo:5: 00000100:00100000:1.0:1789601307.402989:0:7009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601307.403032:0:7009:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc39113c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601307.403051:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880485760 00000100:00100000:1.0:1789601307.403058:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880485760 00000100:00100000:1.0:1789601307.403100:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601307.403121:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7009:x1876532880485760:12345-0@lo:5: 00002000:00080000:1.0:1789601307.403147:0:6676:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789601307.403150:0:6676:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789601307.403379:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7009:x1876532880485760:12345-0@lo:5: Request processed in 258us (387us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789601307.403386:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789601307.403412:0:7009:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ee00c68700 x1876532880485760/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789601323 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601307.403437:0:7009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7009:1876532880485760:0@lo:5: 00000004:00080000:1.0:1789601307.403447:0:7009:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789601307.403471:0:7009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7009:1876532880485888:0@lo:700: 00000100:00100000:1.0:1789601307.403496:0:7009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601307.403513:0:7009:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc39113c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601307.403533:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880485888 00000100:00100000:1.0:1789601307.403536:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880485888 00000100:00100000:1.0:1789601307.403562:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789601307.403569:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7009:x1876532880485888:12345-0@lo:700: 00000100:00100000:1.0:1789601307.403598:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1876532880486016:0@lo:700: 00000100:00100000:1.0:1789601307.403642:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601307.403661:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc3911540 going to sleep for 11 seconds 00000100:00100000:1.0:1789601307.403685:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880486016 00000100:00100000:1.0:1789601307.403689:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880486016 00000100:00100000:1.0:1789601307.403715:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789601307.403721:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1876532880486016:12345-0@lo:700: 40000000:02000000:3.0:1789601307.468430:0:5844:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1789601307.482542:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1876532880486016:12345-0@lo:700: Request processed in 78812us (78890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601307.482568:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789601307.482648:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ee00c6a680 x1876532880486016/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789601323 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601307.482696:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1876532880486016:0@lo:700: 40000000:02000000:3.0:1789601307.482712:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1789601307.635597:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7009:x1876532880485888:12345-0@lo:700: Request processed in 232018us (232090us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601307.635646:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:3.0:1789601307.635685:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789601307.635702:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1789601307.637473:0:7009:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ee00c68380 x1876532880485888/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789601323 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601307.637510:0:7009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7009:1876532880485888:0@lo:700: 00010000:00010000:1.0:1789601307.659204:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789601307.707544:0:7047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000004:02000040:1.0:1789601307.722228:0:7009:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1789601307.725241:0:7009:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7009:1876532880486144:0@lo:5: 00000100:00100000:1.0:1789601307.725312:0:7009:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601307.725366:0:7009:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc2ba3000 going to sleep for 11 seconds 00000100:00100000:1.0:1789601307.725415:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880486144 00000100:00100000:1.0:1789601307.725424:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880486144 00000100:00100000:1.0:1789601307.725471:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601307.725481:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7009:x1876532880486144:12345-0@lo:5: 00002000:00080000:0.0:1789601307.741660:0:6676:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789601307.741680:0:6676:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1789601307.747337:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7009:x1876532880486144:12345-0@lo:5: Request processed in 21846us (22014us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789601307.747365:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789601307.750141:0:7009:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ee00c68380 x1876532880486144/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789601323 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601307.750160:0:7009:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789601307.750178:0:7009:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff91ee00c68380 x1876532880486144/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789601323 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601307.750191:0:7009:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7009:1876532880486144:0@lo:5: 00000004:00080000:1.0:1789601307.750214:0:7009:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1789601308.681001:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601309.705454:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601310.728979:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601311.753013:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601312.746653:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601312.746678:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880486272:0@lo:13: 00000100:00100000:1.0:1789601312.749013:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601312.749265:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880486272 00000100:00100000:1.0:1789601312.749274:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880486272 00000100:00080000:0.0:1789601312.749372:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601312.751726:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789601312.753419:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1876532880486272:12345-0@lo:13: 00002000:00000024:1.0:1789601312.755294:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601312.755390:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1876532880486272:12345-0@lo:13: Request processed in 1979us (6380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601312.755400:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789601312.755549:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ee00c68700 x1876532880486272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601312.755574:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880486272:0@lo:13: 00000100:00100000:1.0:1789601312.755665:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880486400:0@lo:400: 00000100:00100000:1.0:1789601312.755703:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601312.756215:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880486528:0@lo:400: 00000100:00100000:1.0:1789601312.756248:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601312.756271:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601312.756277:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880486656:0@lo:400: 00000100:00100000:1.0:1789601312.756297:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601312.756325:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880486400 00000100:00100000:1.0:1789601312.756331:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880486400 00000100:00100000:1.0:1789601312.756365:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789601312.756372:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:3320:x1876532880486400:12345-0@lo:400: 00000100:00100000:1.0:1789601312.756412:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:3320:x1876532880486400:12345-0@lo:400: Request processed in 41us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601312.756418:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789601312.756443:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880486528 00000100:00100000:1.0:1789601312.756467:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880486528 00000100:00100000:1.0:1789601312.756492:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880486656 00000100:00100000:1.0:1789601312.756494:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880486656 00000100:00100000:1.0:1789601312.756532:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789601312.756538:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880486528:12345-0@lo:400: 00000100:00100000:1.0:1789601312.756573:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880486528:12345-0@lo:400: Request processed in 36us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601312.756579:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789601312.756591:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789601312.756597:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880486656:12345-0@lo:400: 00000100:00100000:1.0:1789601312.756621:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880486656:12345-0@lo:400: Request processed in 25us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601312.756627:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789601312.756665:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880486400:0@lo:400: 00000100:00080000:1.0:1789601312.756687:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789601312.756702:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ee00c69500 x1876532880486656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601312.756713:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880486656:0@lo:400: 00010000:00080000:1.0:1789601312.756723:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ee00c6a300 x1876532880486528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601312.756730:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880486528:0@lo:400: 00010000:00010000:1.0:1789601312.780146:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789601312.880927:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1789601313.801247:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601314.825094:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601315.848989:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601316.876514:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601317.833103:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880486784:0@lo:400: 00000100:00100000:2.0:1789601317.833179:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601317.833239:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880487296:0@lo:13: 00000100:00100000:2.0:1789601317.833266:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601317.833288:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601317.833294:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880486912:0@lo:400: 00000100:00100000:2.0:1789601317.833320:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601317.833350:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880487040:0@lo:400: 00000100:00100000:2.0:1789601317.833375:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601317.833406:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601317.833412:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880487168:0@lo:400: 00000100:00100000:1.0:1789601317.833433:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880486784 00000100:00100000:1.0:1789601317.833442:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880486784 00000100:00100000:2.0:1789601317.833445:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601317.833479:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880487296 00000100:00100000:2.0:1789601317.833482:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880487296 00000100:00100000:1.0:1789601317.833487:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789601317.833519:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789601317.833528:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880487296:12345-0@lo:13: 00002000:00000024:2.0:1789601317.833582:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601317.833629:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880487296:12345-0@lo:13: Request processed in 103us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601317.833637:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601317.833665:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:3319:x1876532880486784:12345-0@lo:400: 00000100:00100000:2.0:1789601317.833685:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880486912 00000100:00100000:2.0:1789601317.833689:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880486912 00000100:00100000:1.0:1789601317.833700:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:3319:x1876532880486784:12345-0@lo:400: Request processed in 40us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601317.833706:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789601317.833713:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880487040 00000100:00100000:2.0:1789601317.833715:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880487040 00000100:00100000:2.0:1789601317.833730:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789601317.833736:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880486912:12345-0@lo:400: 00000100:00100000:2.0:1789601317.833767:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880486912:12345-0@lo:400: Request processed in 31us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601317.833773:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789601317.833782:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789601317.833786:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880487040:12345-0@lo:400: 00000100:00100000:2.0:1789601317.833819:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880487040:12345-0@lo:400: Request processed in 33us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601317.833825:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1789601317.833870:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789601317.833876:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789601317.833903:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ee00c80e00 x1876532880486912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1789601317.833903:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ee00c83b80 x1876532880487040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601317.833917:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880486912:0@lo:400: 00000100:00100000:1.0:1789601317.833917:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880487040:0@lo:400: 00010000:00080000:2.0:1789601317.833927:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ee00c6a300 x1876532880487296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601317.833934:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789601317.833950:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880487296:0@lo:13: 00000100:00100000:2.0:1789601317.833970:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880486784:0@lo:400: 00000100:00100000:0.0:1789601317.837601:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880487168 00000100:00100000:0.0:1789601317.837615:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880487168 00000100:00100000:0.0:1789601317.838103:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601317.838113:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880487168:12345-0@lo:400: 00000100:00100000:0.0:1789601317.838201:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880487168:12345-0@lo:400: Request processed in 92us (4756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601317.838206:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789601317.838279:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ee00c83800 x1876532880487168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601317.838294:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880487168:0@lo:400: 00010000:00010000:1.0:1789601317.904310:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601318.934000:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601319.950718:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789601320.483796:0:7619:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789601320.483800:0:7619:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789601320.483959:0:7619:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91edc7b4a800 00000020:01000004:3.0:1789601320.483976:0:7619:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789601320.483988:0:7619:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789601320.484001:0:7619:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91edc6050000) 00000020:00000080:3.0:1789601320.484016:0:7619:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789601320.497666:0:7619:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789601320.498009:0:7619:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789601320.527989:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789601320.532940:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789601320.532975:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789601320.533023:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789601320.533047:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789601320.533401:0:7619:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789601320.533415:0:7619:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789601320.533426:0:7619:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf3d6e402158abdf8 00000020:01000004:2.0:1789601320.533435:0:7619:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789601320.533458:0:7619:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789601320.533462:0:7619:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789601320.533468:0:7619:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789601320.533570:0:7619:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789601320.533575:0:7619:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789601320.549486:0:7619:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789601320.549595:0:7619:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.130@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789601320.549599:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789601320.549601:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789601320.549602:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789601320.549603:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789601320.549604:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789601320.549609:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789601320.549611:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789601320.549612:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789601320.549613:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789601320.549614:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789601320.549616:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789601320.549619:0:7619:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789601320.549622:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789601320.549623:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789601320.549624:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789601320.549625:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789601320.549626:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789601320.549627:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789601320.549628:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789601320.549628:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789601320.549629:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789601320.549630:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789601320.549631:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789601320.549666:0:7619:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789601320.549685:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880487424:0@lo:253: 00000100:00100000:2.0:1789601320.549764:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601320.549921:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd012ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789601320.550091:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880487424 00000100:00100000:1.0:1789601320.550100:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880487424 00000100:00100000:1.0:1789601320.550185:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789601320.550197:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:7619:x1876532880487424:12345-0@lo:253: 20000000:01000000:1.0:1789601320.550227:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789601320.550232:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1789601320.550237:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1789601320.550242:0:5832:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1789601320.551223:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789601320.551441:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789601320.551454:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789601320.551494:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1789601320.551502:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789601320.551534:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1789601320.551579:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1789601320.551949:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1789601320.551968:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.130@tcp 20000000:01000000:1.0:1789601320.551977:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:1.0:1789601320.552013:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1789601320.552021:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789601320.552059:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789601320.552067:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:1.0:1789601320.552092:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789601320.552100:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789601320.552136:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789601320.552175:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789601320.552934:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1789601320.552954:0:5832:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.130@tcp 20000000:01000000:1.0:1789601320.552956:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.130@tcp (null) (null) (null) 00000040:00080000:1.0:1789601320.552989:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1789601320.552996:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789601320.553026:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1789601320.553033:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.130@tcp (null) (null) 00000040:00080000:1.0:1789601320.553060:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1789601320.553068:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789601320.554184:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1789601320.554235:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1789601320.554262:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1789601320.554266:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1789601320.554272:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789601320.554274:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789601320.554277:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789601320.554291:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789601320.554294:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789601320.554333:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789601320.554335:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789601320.554916:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789601320.554967:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789601320.555022:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789601320.555327:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1789601320.555370:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1789601320.555423:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1789601320.555447:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789601320.555450:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789601320.556249:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1789601320.556308:0:7622:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1789601320.556343:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1789601320.556650:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1789601320.556690:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1789601320.556735:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1789601320.556746:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789601320.556748:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789601320.557131:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1789601320.557308:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1789601320.557343:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1789601320.557426:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1789601320.557438:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789601320.557441:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789601320.558110:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1789601320.558157:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1789601320.558215:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789601320.558468:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789601320.558582:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789601320.558656:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:1.0:1789601320.558675:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789601320.558695:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91edc3b88e00/0xf3d6e402158abdff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.558713:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc3b88800/0xf3d6e402158abd50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abd49 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.558721:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc29c5a00/0xf3d6e402158abd7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abd73 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.558727:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc29c4600/0xf3d6e402158abda4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abd9d expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.558733:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abdc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abdb9 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.558741:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abdea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abde3 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.558758:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91edc3b88e00/0xf3d6e402158abdff lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.558800:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abdea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abde3 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.558817:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abdea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abde3 expref: 16 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601320.558933:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c69500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876532880487552:0@lo:104: 00000100:00100000:1.0:1789601320.559011:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789601320.559100:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abdc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abdb9 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.559108:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abdc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abdb9 expref: 16 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601320.559116:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876532880487680:0@lo:104: 00010000:00010000:1.0:1789601320.559136:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc29c4600/0xf3d6e402158abda4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abd9d expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.559143:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edc29c4600/0xf3d6e402158abda4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abd9d expref: 16 pid: 5832 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601320.559150:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876532880487808:0@lo:104: 00010000:00010000:1.0:1789601320.559186:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc29c5a00/0xf3d6e402158abd7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abd73 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.559194:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edc29c5a00/0xf3d6e402158abd7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abd73 expref: 16 pid: 5830 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601320.559208:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876532880487936:0@lo:104: 00010000:00010000:1.0:1789601320.559233:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc3b88800/0xf3d6e402158abd50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abd49 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.559240:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edc3b88800/0xf3d6e402158abd50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abd49 expref: 16 pid: 5830 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601320.559247:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876532880488064:0@lo:104: 00000100:00100000:1.0:1789601320.559263:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ee002b1240 going to sleep for 11 seconds 00000100:00100000:2.0:1789601320.559316:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789601320.559334:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601320.559466:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601320.559653:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601320.559681:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880487552 00000100:00100000:1.0:1789601320.559689:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880487552 00000100:00100000:1.0:1789601320.559727:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880487680 00000100:00100000:1.0:1789601320.559730:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880487680 00000100:00100000:1.0:1789601320.559741:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880487808 00000100:00100000:1.0:1789601320.559743:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880487808 00000100:00100000:1.0:1789601320.559757:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789601320.559765:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+5:5832:x1876532880487552:12345-0@lo:104: 00010000:00010000:1.0:1789601320.559779:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abde3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abdea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.559874:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789601320.559880:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+5:5832:x1876532880487552:12345-0@lo:104: Request processed in 117us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601320.559887:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789601320.559927:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789601320.559934:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+4:5832:x1876532880487680:12345-0@lo:104: 00010000:00010000:1.0:1789601320.559941:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abdb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abdc0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.559983:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789601320.559989:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+4:5832:x1876532880487680:12345-0@lo:104: Request processed in 56us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601320.559995:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789601320.560008:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789601320.560015:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:5832:x1876532880487808:12345-0@lo:104: 00010000:00010000:1.0:1789601320.560022:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abd9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abda4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.560047:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789601320.560052:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:5832:x1876532880487808:12345-0@lo:104: Request processed in 38us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601320.560058:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789601320.560074:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789601320.560080:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abde3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abdea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.560087:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89e00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601320.560092:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abde3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abdea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.560100:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abde3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abdea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601320.560108:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abde3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abdea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601320.560114:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601320.560149:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abde3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abdea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.560156:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601320.560175:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abde3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abdea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.560182:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc3b89e00/0xf3d6e402158abde3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abdea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.560197:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789601320.560201:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abdb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abdc0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.560206:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5400 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601320.560209:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abdb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abdc0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.560215:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abdb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abdc0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601320.560222:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abdb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abdc0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601320.560227:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601320.560239:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abdb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abdc0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.560244:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601320.560257:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abdb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abdc0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.560275:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abdb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abdc0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.560285:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601320.560288:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abd9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abda4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.560293:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0031e00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601320.560296:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abd9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abda4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.560303:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abd9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abda4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601320.560309:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abd9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abda4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601320.560314:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601320.560326:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abd9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abda4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.560331:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601320.560336:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abd9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abda4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.560343:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abd9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abda4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.560353:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601320.560359:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601320.560361:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601320.560456:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c69500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876532880487552:0@lo:104: 00000100:00100000:3.0:1789601320.560466:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876532880487680:0@lo:104: 00000100:00100000:3.0:1789601320.560472:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876532880487808:0@lo:104: 00010000:00010000:0.0:1789601320.560584:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601320.560694:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601320.560707:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880488192:0@lo:103: 00000100:00100000:3.0:1789601320.560743:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601320.560877:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880488192 00000100:00100000:1.0:1789601320.560882:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880488192 00010000:00010000:1.0:1789601320.560902:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abdea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abde3 expref: 17 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601320.560930:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789601320.560937:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8de9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:3319:x1876532880488192:12345-0@lo:103: 00010000:00010000:1.0:1789601320.560947:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601320.560952:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abdea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abde3 expref: 17 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.560962:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abdea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abde3 expref: 17 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.560975:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abdea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abde3 expref: 17 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.560987:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601320.561024:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8de9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:3319:x1876532880488192:12345-0@lo:103: Request processed in 88us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601320.561031:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789601320.561093:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880488192:0@lo:103: 00000100:00100000:3.0:1789601320.563739:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880488320:0@lo:103: 00000100:00100000:3.0:1789601320.563813:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601320.563902:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601320.563909:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880488448:0@lo:103: 00000100:00100000:3.0:1789601320.563968:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601320.564062:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880488320 00000100:00100000:1.0:1789601320.564071:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880488320 00010000:00010000:1.0:1789601320.564104:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abdc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abdb9 expref: 16 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601320.564134:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880488448 00000100:00100000:1.0:1789601320.564137:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880488448 00010000:00010000:1.0:1789601320.564147:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc29c4600/0xf3d6e402158abda4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abd9d expref: 17 pid: 5832 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601320.564168:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789601320.564174:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8dea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:3317:x1876532880488320:12345-0@lo:103: 00010000:00010000:1.0:1789601320.564188:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601320.564194:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abdc0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abdb9 expref: 17 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.564205:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abdc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abdb9 expref: 17 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.564222:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abdc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abdb9 expref: 17 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.564238:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601320.564275:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8dea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:3317:x1876532880488320:12345-0@lo:103: Request processed in 100us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601320.564282:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789601320.564298:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789601320.564304:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8dead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:3317:x1876532880488448:12345-0@lo:103: 00010000:00010000:1.0:1789601320.564310:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601320.564314:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc29c4600/0xf3d6e402158abda4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abd9d expref: 15 pid: 5832 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.564323:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc29c4600/0xf3d6e402158abda4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abd9d expref: 15 pid: 5832 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.564333:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc29c4600/0xf3d6e402158abda4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abd9d expref: 15 pid: 5832 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.564353:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601320.564386:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8dead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:3317:x1876532880488448:12345-0@lo:103: Request processed in 82us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601320.564391:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789601320.564427:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880488448:0@lo:103: 00000100:00100000:1.0:1789601320.564434:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880488320:0@lo:103: 00000100:00100000:2.0:1789601320.565167:0:5820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601320.565331:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880487936 00000100:00100000:1.0:1789601320.565337:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880487936 00000100:00100000:1.0:1789601320.565362:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880488064 00000100:00100000:1.0:1789601320.565365:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880488064 00000100:00100000:1.0:1789601320.565389:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789601320.565397:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+4:5832:x1876532880487936:12345-0@lo:104: 00010000:00010000:1.0:1789601320.565410:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abd73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abd7a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601320.565647:0:5820:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1789601320.565656:0:5820:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1789601320.565766:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789601320.565773:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+4:5832:x1876532880487936:12345-0@lo:104: Request processed in 378us (6121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601320.565780:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789601320.565796:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789601320.565803:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:5832:x1876532880488064:12345-0@lo:104: 00010000:00010000:1.0:1789601320.565811:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abd49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abd50 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601320.565923:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6b800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876532880487936:0@lo:104: 00000100:00100000:3.0:1789601320.565932:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5832:1876532880488064:0@lo:104: 00010000:00010000:3.0:1789601320.565962:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91edc3b88e00/0xf3d6e402158abdff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.566220:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789601320.566228:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abd73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abd7a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.566235:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89800 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:0.0:1789601320.566239:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abd73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abd7a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.566257:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abd73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abd7a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601320.566264:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abd73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abd7a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601320.566269:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789601320.566344:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abd73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abd7a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.566352:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601320.566388:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abd73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abd7a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.566395:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abd73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abd7a expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.566405:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601320.566408:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abd49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abd50 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.566413:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4400 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:0.0:1789601320.566416:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abd49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abd50 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.566422:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abd49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abd50 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601320.566428:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abd49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abd50 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601320.566440:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601320.566464:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1789601320.566471:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:5832:x1876532880488064:12345-0@lo:104: Request processed in 669us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601320.566483:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789601320.566578:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880488576:0@lo:103: 00000100:00100000:3.0:1789601320.566617:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601320.566687:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880488576 00000100:00100000:1.0:1789601320.566693:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880488576 00010000:00010000:1.0:1789601320.566713:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc29c5a00/0xf3d6e402158abd7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abd73 expref: 14 pid: 5830 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601320.566742:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789601320.566749:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:3319:x1876532880488576:12345-0@lo:103: 00010000:00010000:1.0:1789601320.566759:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601320.566764:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc29c5a00/0xf3d6e402158abd7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abd73 expref: 14 pid: 5830 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.566774:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc29c5a00/0xf3d6e402158abd7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abd73 expref: 14 pid: 5830 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.566787:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc29c5a00/0xf3d6e402158abd7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abd73 expref: 14 pid: 5830 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.566799:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601320.566830:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8de9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:3319:x1876532880488576:12345-0@lo:103: Request processed in 82us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601320.566860:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789601320.566888:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880488576:0@lo:103: 00010000:00010000:0.0:1789601320.567120:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abd49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abd50 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.567127:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601320.567143:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abd49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abd50 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.567149:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abd49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abd50 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.567163:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601320.567165:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601320.567166:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601320.567176:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880488704:0@lo:103: 00000100:00100000:0.0:1789601320.567201:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789601320.567236:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601320.567271:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880488704 00000100:00100000:3.0:1789601320.567275:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880488704 00010000:00010000:3.0:1789601320.567289:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc3b88800/0xf3d6e402158abd50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abd49 expref: 13 pid: 5830 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601320.567315:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789601320.567322:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:3320:x1876532880488704:12345-0@lo:103: 00010000:00010000:3.0:1789601320.567330:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601320.567334:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc3b88800/0xf3d6e402158abd50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abd49 expref: 13 pid: 5830 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.567344:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc3b88800/0xf3d6e402158abd50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abd49 expref: 13 pid: 5830 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.567355:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc3b88800/0xf3d6e402158abd50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abd49 expref: 13 pid: 5830 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.567366:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91edc3b88e00/0xf3d6e402158abdff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.567386:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc3b88e00/0xf3d6e402158abdff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.567410:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edc3b88e00/0xf3d6e402158abdff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.567417:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edc3b88e00/0xf3d6e402158abdff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.567423:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91edc3b88e00/0xf3d6e402158abdff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.567429:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91edc3b88e00/0xf3d6e402158abdff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.567435:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88e00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601320.567438:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91edc3b88e00/0xf3d6e402158abdff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.567457:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91edc3b88e00/0xf3d6e402158abdff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.567470:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91edc3b88e00/0xf3d6e402158abdff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.567481:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601320.567520:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:3320:x1876532880488704:12345-0@lo:103: Request processed in 198us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601320.567525:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789601320.567544:0:5832:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91edc3b88e00/0xf3d6e402158abdff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.567552:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91edc3b88e00/0xf3d6e402158abdff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.567564:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc3b88e00/0xf3d6e402158abdff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789601320.567578:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789601320.567795:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880488704:0@lo:103: 00000100:00100000:3.0:1789601320.607395:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:7619:x1876532880487424:12345-0@lo:253: Request processed in 57191us (57621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601320.607412:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789601320.607571:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880487424:0@lo:253: 10000000:01000000:2.0:1789601320.607589:0:7619:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789601320.607593:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789601320.607595:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789601320.607596:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789601320.607598:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789601320.607599:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789601320.607600:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789601320.607602:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789601320.607604:0:7619:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789601320.607605:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789601320.607607:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789601320.607632:0:7619:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91edc7b4a800 from lustre-OST0001 10000000:01000000:2.0:1789601320.607684:0:7619:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789601320.607687:0:7619:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789601320.607694:0:7619:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91edc6010000 local copy 10000000:01000000:2.0:1789601320.607698:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789601320.607735:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601320.607746:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601320.607756:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601320.607775:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880488832:0@lo:101: 00000100:00100000:2.0:1789601320.607814:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601320.607920:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc702f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789601320.608017:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880488832 00000100:00100000:1.0:1789601320.608024:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880488832 00000100:00100000:0.0:1789601320.608175:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789601320.608185:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+11:7619:x1876532880488832:12345-0@lo:101: 00010000:00010000:0.0:1789601320.608196:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601320.608209:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc0031c00/0xf3d6e402158abe0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abe06 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.608233:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc0031c00/0xf3d6e402158abe0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abe06 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.608244:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc0031c00/0xf3d6e402158abe0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abe06 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.608262:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc0031c00, rc 0) 00000100:00100000:0.0:1789601320.608348:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:7619:x1876532880488832:12345-0@lo:101: Request processed in 164us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601320.608354:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789601320.608441:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880488832:0@lo:101: 00010000:00010000:3.0:1789601320.608455:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf3d6e402158abe0d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.608465:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf3d6e402158abe0d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601320.608575:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880488960:0@lo:501: 00000100:00100000:3.0:1789601320.608605:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601320.608667:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601320.608756:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880488960 00000100:00100000:0.0:1789601320.608760:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880488960 00000100:00100000:0.0:1789601320.608791:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789601320.608797:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:7619:x1876532880488960:12345-0@lo:501: 00000100:00100000:0.0:1789601320.609064:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:7619:x1876532880488960:12345-0@lo:501: Request processed in 266us (457us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789601320.609070:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789601320.609190:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880488960:0@lo:501: 10000000:01000000:3.0:1789601320.609204:0:7619:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789601320.609229:0:7619:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789601320.609235:0:7619:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf3d6e402158abe0d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.609243:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf3d6e402158abe0d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.609250:0:7619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf3d6e402158abe0d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.609314:0:7619:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789601320.609333:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91edc7b4a800 10000000:01000000:3.0:1789601320.609338:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789601320.609344:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789601320.609346:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789601320.609351:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789601320.609353:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789601320.609381:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abe14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.609389:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abe14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.609397:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abe14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601320.609409:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880489088:0@lo:101: 00000100:00100000:3.0:1789601320.609434:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601320.609463:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64780 going to sleep for 11 seconds 00000100:00100000:1.0:1789601320.609519:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880489088 00000100:00100000:1.0:1789601320.609524:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880489088 00000100:00100000:1.0:1789601320.609555:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789601320.609562:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:7619:x1876532880489088:12345-0@lo:101: 00010000:00010000:1.0:1789601320.609575:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601320.609584:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abe1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abe14 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.609600:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abe1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abe14 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.609609:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abe1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abe14 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.609615:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88400, rc 0) 00000100:00100000:1.0:1789601320.609652:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880489088:12345-0@lo:101: Request processed in 90us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601320.609658:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789601320.609816:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880489088:0@lo:101: 00010000:00010000:3.0:1789601320.609826:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abe14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe1b expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.609833:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abe14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abe1b expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601320.609915:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880489216:0@lo:501: 00000100:00100000:3.0:1789601320.609946:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601320.609973:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64780 going to sleep for 11 seconds 00000100:00100000:2.0:1789601320.610029:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880489216 00000100:00100000:2.0:1789601320.610039:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880489216 00000100:00100000:2.0:1789601320.610060:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789601320.610066:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880489216:12345-0@lo:501: 00000100:00100000:2.0:1789601320.610240:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880489216:12345-0@lo:501: Request processed in 174us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601320.610247:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789601320.610314:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880489216:0@lo:501: 00000100:00100000:3.0:1789601320.610337:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880489344:0@lo:503: 00000100:00100000:3.0:1789601320.610367:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601320.610396:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64780 going to sleep for 11 seconds 00000100:00100000:2.0:1789601320.610447:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880489344 00000100:00100000:2.0:1789601320.610452:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880489344 00000100:00100000:2.0:1789601320.610480:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789601320.610486:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880489344:12345-0@lo:503: 00000100:00100000:2.0:1789601320.610626:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880489344:12345-0@lo:503: Request processed in 140us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601320.610633:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789601320.610756:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880489344:0@lo:503: 00000040:00080000:3.0:1789601320.611018:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789601320.611068:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880489472:0@lo:502: 00000100:00100000:3.0:1789601320.611097:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601320.611116:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64780 going to sleep for 11 seconds 00000100:00100000:1.0:1789601320.611172:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880489472 00000100:00100000:1.0:1789601320.611176:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880489472 00000100:00100000:1.0:1789601320.611203:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789601320.611210:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880489472:12345-0@lo:502: 00000100:00100000:1.0:1789601320.611326:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880489472:12345-0@lo:502: Request processed in 116us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601320.611333:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789601320.611451:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880489472:0@lo:502: 00000040:00080000:3.0:1789601320.611699:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789601320.611750:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789601320.611786:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789601320.611834:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789601320.611909:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789601320.611946:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789601320.611972:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880489600:0@lo:502: 00000100:00100000:3.0:1789601320.612017:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601320.612038:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64780 going to sleep for 11 seconds 00000100:00100000:1.0:1789601320.612156:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880489600 00000100:00100000:1.0:1789601320.612161:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880489600 00000100:00100000:1.0:1789601320.612194:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789601320.612201:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880489600:12345-0@lo:502: 00000100:00100000:1.0:1789601320.612338:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880489600:12345-0@lo:502: Request processed in 137us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601320.612344:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789601320.612478:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8deaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880489600:0@lo:502: 00000040:00080000:3.0:1789601320.612618:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789601320.612628:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00010000:00010000:0.0:1789601320.613079:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601320.613090:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf3d6e402158abe0d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.613099:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4400 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:0.0:1789601320.613103:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf3d6e402158abe0d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.613113:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf3d6e402158abe0d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601320.613121:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf3d6e402158abe0d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601320.613127:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789601320.613152:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf3d6e402158abe0d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.613173:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789601320.613206:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf3d6e402158abe0d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.613214:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf3d6e402158abe0d expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.613228:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601320.613230:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601320.613231:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601320.613275:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880489728:0@lo:103: 00000100:00100000:3.0:1789601320.613315:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601320.613451:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880489728 00000100:00100000:0.0:1789601320.613458:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880489728 00000100:00100000:0.0:1789601320.613509:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789601320.613517:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:3317:x1876532880489728:12345-0@lo:103: 00010000:00010000:0.0:1789601320.613528:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601320.613542:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc0031c00/0xf3d6e402158abe0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3d6e402158abe06 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.613555:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601320.613598:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8deaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:3317:x1876532880489728:12345-0@lo:103: Request processed in 82us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601320.613604:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789601320.613724:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880489728:0@lo:103: 00000020:01000000:1.0:1789601320.613909:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789601320.613917:0:7626:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789601320.613923:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601320.613926:0:7626:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789601320.613931:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789601320.613947:0:7626:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff91edc6013380) 00000020:00000080:1.0:1789601320.613969:0:7626:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789601320.613975:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789601320.614056:0:7626:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91edc7b4a800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789601320.614064:0:7626:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789601320.614072:0:7626:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf3d6e402158abe29 00010000:00010000:0.0:1789601320.618298:0:7626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1789601320.618782:0:7626:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1789601320.621345:0:7626:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789601320.621765:0:7626:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1789601320.632415:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1789601320.633331:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789601320.634788:0:7626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789601320.634800:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601320.634807:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601320.634809:0:7626:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789601320.634813:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601320.634817:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601320.634819:0:7626:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789601320.634821:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789601320.634823:0:7626:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789601320.635016:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601320.635020:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601320.635021:0:7626:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789601320.635025:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789601320.635959:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789601320.635988:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789601320.636045:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abe14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe1b expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.636059:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abe14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe1b expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601320.636067:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91edc7b4a800 from 1 10000000:01000000:3.0:1789601320.636070:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789601320.637464:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee02044e00/0xf3d6e402158abe30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.637479:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91ee02044e00/0xf3d6e402158abe30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.637491:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91ee02044e00/0xf3d6e402158abe30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601320.637615:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8debb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880489856:0@lo:101: 00000100:00100000:3.0:1789601320.637685:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601320.637740:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe646c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601320.640651:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880489856 00000100:00100000:1.0:1789601320.640665:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880489856 00000100:00100000:1.0:1789601320.640722:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789601320.640732:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:7619:x1876532880489856:12345-0@lo:101: 00010000:00010000:1.0:1789601320.640749:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601320.640769:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc3b89e00/0xf3d6e402158abe37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abe30 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.640798:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc3b89e00/0xf3d6e402158abe37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abe30 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.640809:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc3b89e00/0xf3d6e402158abe37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abe30 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.640817:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b89e00, rc 0) 00000100:00100000:1.0:1789601320.640909:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880489856:12345-0@lo:101: Request processed in 178us (3224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601320.640915:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789601320.640973:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8debb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880489856:0@lo:101: 00010000:00010000:1.0:1789601320.641000:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91ee02044e00/0xf3d6e402158abe30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe37 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.641009:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91ee02044e00/0xf3d6e402158abe30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abe37 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601320.641111:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880489984:0@lo:501: 00000100:00100000:1.0:1789601320.641140:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601320.641172:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ee002b1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789601320.642405:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880489984 00000100:00100000:0.0:1789601320.642419:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880489984 00000100:00100000:0.0:1789601320.642682:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789601320.642692:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880489984:12345-0@lo:501: 00000100:00100000:0.0:1789601320.642992:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880489984:12345-0@lo:501: Request processed in 302us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601320.643000:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789601320.643771:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880489984:0@lo:501: 00000100:00100000:1.0:1789601320.643824:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880490112:0@lo:503: 00000100:00100000:1.0:1789601320.644035:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601320.644107:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ee002b1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601320.644140:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880490112 00000100:00100000:2.0:1789601320.644145:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880490112 00000100:00100000:2.0:1789601320.644207:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789601320.644216:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880490112:12345-0@lo:503: 00000100:00100000:2.0:1789601320.644599:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880490112:12345-0@lo:503: Request processed in 370us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601320.644608:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789601320.644687:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880490112:0@lo:503: 00000040:00080000:1.0:1789601320.645041:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789601320.645124:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880490240:0@lo:502: 00000100:00100000:1.0:1789601320.645159:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601320.646026:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ee002b1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789601320.646084:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880490240 00000100:00100000:0.0:1789601320.646091:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880490240 00000100:00100000:0.0:1789601320.646124:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789601320.646131:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880490240:12345-0@lo:502: 00000100:00100000:0.0:1789601320.646352:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880490240:12345-0@lo:502: Request processed in 220us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601320.646359:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789601320.646474:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880490240:0@lo:502: 00000040:00080000:1.0:1789601320.646745:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789601320.646795:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789601320.646827:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880490368:0@lo:502: 00000100:00100000:1.0:1789601320.646909:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601320.646929:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ee002b1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789601320.647070:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880490368 00000100:00100000:0.0:1789601320.647075:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880490368 00000100:00100000:0.0:1789601320.647097:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789601320.647109:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880490368:12345-0@lo:502: 00000100:00100000:0.0:1789601320.647224:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880490368:12345-0@lo:502: Request processed in 116us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601320.647231:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789601320.647334:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880490368:0@lo:502: 00000040:00080000:1.0:1789601320.647429:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789601320.647439:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789601320.647934:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601320.647942:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601320.647945:0:7630:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789601320.647951:0:7630:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91edc7b4a800 00000020:00000080:1.0:1789601320.647953:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789601320.647968:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601320.647971:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601320.647972:0:7630:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789601320.647975:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789601320.648077:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789601320.648094:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789601320.648112:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee02044e00/0xf3d6e402158abe30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe37 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.648124:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91ee02044e00/0xf3d6e402158abe30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe37 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601320.648172:0:7619:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789601320.648175:0:7619:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91edc7b4a800 10000000:01000000:0.0:1789601320.648178:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91edc7b4a800 10000000:01000000:0.0:1789601320.648182:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789601320.648187:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91edc7b4a800 from 1 10000000:01000000:0.0:1789601320.648190:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789601320.648217:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abe3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.648226:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abe3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.648236:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abe3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601320.648249:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880490496:0@lo:101: 00000100:00100000:0.0:1789601320.648288:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601320.648321:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede9e690c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601320.648334:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880490496 00000100:00100000:0.0:1789601320.648338:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880490496 00000100:00100000:0.0:1789601320.648358:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789601320.648363:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880490496:12345-0@lo:101: 00010000:00010000:0.0:1789601320.648383:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601320.648395:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc0031e00/0xf3d6e402158abe45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abe3e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.648417:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc0031e00/0xf3d6e402158abe45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abe3e expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.648427:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc0031e00/0xf3d6e402158abe45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abe3e expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.648434:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc0031e00, rc 0) 00000100:00100000:0.0:1789601320.648475:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:7619:x1876532880490496:12345-0@lo:101: Request processed in 111us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601320.648481:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789601320.648529:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880490496:0@lo:101: 00010000:00010000:0.0:1789601320.648543:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abe3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe45 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601320.648551:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abe3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abe45 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601320.648619:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880490624:0@lo:501: 00000100:00100000:0.0:1789601320.648643:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601320.648656:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede9e690c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601320.648673:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880490624 00000100:00100000:0.0:1789601320.648676:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880490624 00000100:00100000:0.0:1789601320.648692:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789601320.648697:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:7619:x1876532880490624:12345-0@lo:501: 00000100:00100000:0.0:1789601320.648924:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:7619:x1876532880490624:12345-0@lo:501: Request processed in 225us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601320.648931:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789601320.648960:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880490624:0@lo:501: 00000100:00100000:0.0:1789601320.648985:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880490752:0@lo:503: 00000100:00100000:0.0:1789601320.649020:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601320.649038:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede9e690c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601320.649048:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880490752 00000100:00100000:0.0:1789601320.649051:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880490752 00000100:00100000:0.0:1789601320.649065:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789601320.649070:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:7619:x1876532880490752:12345-0@lo:503: 00000100:00100000:0.0:1789601320.649190:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:7619:x1876532880490752:12345-0@lo:503: Request processed in 120us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601320.649197:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789601320.649227:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880490752:0@lo:503: 00000040:00080000:0.0:1789601320.649454:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789601320.649505:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880490880:0@lo:502: 00000100:00100000:0.0:1789601320.649536:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601320.649549:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc50bb840 going to sleep for 11 seconds 00000100:00100000:0.0:1789601320.649562:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880490880 00000100:00100000:0.0:1789601320.649566:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880490880 00000100:00100000:0.0:1789601320.649582:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789601320.649588:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:7619:x1876532880490880:12345-0@lo:502: 00000100:00100000:0.0:1789601320.649737:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:7619:x1876532880490880:12345-0@lo:502: Request processed in 148us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601320.649744:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789601320.649780:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880490880:0@lo:502: 00000040:00080000:0.0:1789601320.650015:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789601320.650054:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789601320.650080:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789601320.650115:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789601320.650143:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789601320.650187:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789601320.650217:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789601320.650242:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789601320.650277:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789601320.650306:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789601320.650339:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789601320.650404:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789601320.650440:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789601320.650474:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789601320.650517:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789601320.650566:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789601320.650600:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789601320.650661:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789601320.650697:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789601320.650730:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789601320.650779:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789601320.650816:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789601320.650880:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789601320.650930:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789601320.650965:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789601320.650998:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789601320.651043:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789601320.651080:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1789601320.651106:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789601320.651153:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1789601320.651183:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1789601320.651219:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1789601320.651245:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1789601320.651281:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1789601320.651312:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1789601320.651356:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1789601320.652172:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1789601320.652217:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880491008:0@lo:502: 00000100:00100000:0.0:1789601320.652291:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601320.652369:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc50bb840 going to sleep for 11 seconds 00000100:00100000:2.0:1789601320.652423:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880491008 00000100:00100000:2.0:1789601320.652431:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880491008 00000100:00100000:2.0:1789601320.652645:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789601320.652656:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:7619:x1876532880491008:12345-0@lo:502: 00000100:00100000:2.0:1789601320.652930:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:7619:x1876532880491008:12345-0@lo:502: Request processed in 275us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601320.652946:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789601320.653155:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880491008:0@lo:502: 00000040:00080000:0.0:1789601320.653240:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1789601320.653251:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789601320.653806:0:7631:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789601320.653822:0:7631:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff91edc60519c0) 00000020:00000080:3.0:1789601320.653878:0:7631:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1789601320.653972:0:7631:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91edc7b4a800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789601320.653976:0:7631:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91edc7b4a800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789601320.653978:0:7631:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91edc7b4a800 3 00010000:00080000:3.0:1789601320.654005:0:7631:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91edfb9ab000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.130@tcp at head 00010000:00010000:3.0:1789601320.655580:0:7631:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1789601320.655781:0:7631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789601320.655827:0:7631:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789601320.655862:0:7631:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf3d6e402158abe53 00000100:00080000:3.0:1789601320.655871:0:7631:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789601320.655881:0:7631:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91edfb9ab000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1789601320.655916:0:7631:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91edd8deb100 x1876532880491136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789601320.655937:0:7631:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789601320.656018:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880491520:0@lo:400: 00000100:00100000:3.0:1789601320.656081:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601320.656118:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601320.656125:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880491392:0@lo:400: 00000100:00100000:3.0:1789601320.656149:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601320.656183:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880491520 00000100:00100000:3.0:1789601320.656191:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880491520 00000100:00100000:3.0:1789601320.656252:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789601320.656261:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8de9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880491520:12345-0@lo:400: 00000100:00100000:3.0:1789601320.656313:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8de9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880491520:12345-0@lo:400: Request processed in 54us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601320.656320:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789601320.656360:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edd8de8000 x1876532880491520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601320.656388:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880491520:0@lo:400: 00000100:00100000:2.0:1789601320.659199:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1876532880491136:0@lo:38: 00000100:00100000:2.0:1789601320.659274:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601320.659343:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880491264:0@lo:400: 00000100:00100000:2.0:1789601320.659368:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601320.659416:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880491392 00000100:00100000:2.0:1789601320.659424:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880491392 00000100:00100000:2.0:1789601320.659465:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880491136 00000100:00100000:2.0:1789601320.659469:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880491136 00000100:00100000:2.0:1789601320.659477:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880491264 00000100:00100000:2.0:1789601320.659479:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880491264 00000100:00100000:2.0:1789601320.659562:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789601320.659574:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880491392:12345-0@lo:400: 00000100:00100000:2.0:1789601320.659634:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880491392:12345-0@lo:400: Request processed in 63us (3483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601320.659640:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789601320.659658:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789601320.659664:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880491264:12345-0@lo:400: 00000100:00100000:2.0:1789601320.659696:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880491264:12345-0@lo:400: Request processed in 32us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601320.659701:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789601320.659713:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789601320.659717:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3316:x1876532880491136:12345-0@lo:38: 00010000:00080000:2.0:1789601320.659738:0:5839:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1789601320.659777:0:5839:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf3d6e402158abe5a 00000004:00100000:2.0:1789601320.659795:0:5839:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789601320.659867:0:5839:0:(import.c:65:import_set_state_nolock()) ffff91ee00c8c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789601320.659906:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876532880491136:12345-0@lo:38: Request processed in 188us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601320.659913:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789601320.659931:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789601320.659936:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789601320.659968:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edd8de8380 x1876532880491264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601320.659982:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8de8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880491264:0@lo:400: 00010000:00080000:2.0:1789601320.660011:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edd8deb100 x1876532880491136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789601330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601320.660019:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789601320.660025:0:3316:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789601320.660033:0:3316:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789601320.660038:0:3316:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789601320.660041:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91edfb9ab000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789601320.660046:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8deb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1876532880491136:0@lo:38: 00010000:00080000:2.0:1789601320.660085:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edd8de8a80 x1876532880491392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601320.660095:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8de8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880491392:0@lo:400: 00000040:00080000:3.0:1789601320.660729:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1789601320.660944:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7632:1876532880491648:0@lo:901: 00000100:00100000:1.0:1789601320.660989:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601320.661018:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffc970c0 going to sleep for 11 seconds 00000020:01000000:2.0:1789601320.661076:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789601320.661105:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789601320.661126:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abe3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe45 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601320.661138:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abe3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe45 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789601320.661189:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789601320.661191:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789601320.661192:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789601320.661194:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789601320.661195:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789601320.661196:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789601320.661198:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789601320.661200:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789601320.661201:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789601320.661203:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789601320.661205:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789601320.661209:0:7619:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789601320.661212:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789601320.661213:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789601320.661214:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789601320.661215:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789601320.661216:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789601320.661218:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789601320.661219:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789601320.661220:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789601320.661221:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789601320.661222:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789601320.661223:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789601320.661239:0:7619:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789601320.661247:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880491776:0@lo:253: 00000100:00100000:2.0:1789601320.661279:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601320.661305:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd012ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1789601320.661322:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880491776 00000100:00100000:2.0:1789601320.661328:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880491776 00000100:00100000:2.0:1789601320.661358:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789601320.661366:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:7619:x1876532880491776:12345-0@lo:253: 20000000:01000000:2.0:1789601320.661408:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789601320.661422:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789601320.661620:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880491648 00000100:00100000:3.0:1789601320.661626:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880491648 00000100:00100000:3.0:1789601320.661657:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789601320.661663:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7632:x1876532880491648:12345-0@lo:901: 00000100:00100000:3.0:1789601320.662032:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7632:x1876532880491648:12345-0@lo:901: Request processed in 367us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601320.662040:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789601320.662123:0:7632:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ee00c6a300 x1876532880491648/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789601336 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601320.662136:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7632:1876532880491648:0@lo:901: 00000100:00080000:2.0:1789601320.662712:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:2.0:1789601320.695317:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789601320.695339:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789601320.695405:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789601320.695411:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789601320.695436:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abe61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.695455:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abdb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abdab expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.695465:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abe61 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.695517:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abdb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abdab expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601320.695544:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abdb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abdab expref: 14 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601320.695558:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8de8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1876532880491904:0@lo:104: 00000100:00100000:3.0:1789601320.695630:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601320.695676:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64480 going to sleep for 11 seconds 00000100:00100000:2.0:1789601320.696051:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880491904 00000100:00100000:2.0:1789601320.696061:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880491904 00000100:00100000:2.0:1789601320.696115:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789601320.696125:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8deb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:5853:x1876532880491904:12345-0@lo:104: 00010000:00010000:2.0:1789601320.696138:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc0031400/0xf3d6e402158abdab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abdb2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601320.696197:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789601320.696202:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8deb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:5853:x1876532880491904:12345-0@lo:104: Request processed in 79us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601320.696209:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789601320.696230:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601320.696235:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc0031400/0xf3d6e402158abdab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abdb2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601320.696242:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0031400 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:2.0:1789601320.696246:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc0031400/0xf3d6e402158abdab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abdb2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601320.696254:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc0031400/0xf3d6e402158abdab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abdb2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601320.696260:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc0031400/0xf3d6e402158abdab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abdb2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601320.696265:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789601320.696294:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc0031400/0xf3d6e402158abdab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abdb2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601320.696318:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601320.696337:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc0031400/0xf3d6e402158abdab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abdb2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601320.696344:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc0031400/0xf3d6e402158abdab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abdb2 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601320.696361:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601320.696363:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601320.696365:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601320.696393:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880492032:0@lo:103: 00000100:00100000:2.0:1789601320.696428:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601320.696722:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8de8000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1876532880491904:0@lo:104: 00010000:00010000:3.0:1789601320.696742:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abe61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601320.698009:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880492032 00000100:00100000:1.0:1789601320.698019:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880492032 00010000:00010000:1.0:1789601320.698051:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abdb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abdab expref: 15 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601320.698083:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789601320.698089:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2224c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:3317:x1876532880492032:12345-0@lo:103: 00010000:00010000:1.0:1789601320.698099:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601320.698102:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abdb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abdab expref: 15 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.698110:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abdb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abdab expref: 15 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.698131:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abdb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abdab expref: 15 pid: 5831 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.698144:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abe61 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.698150:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abe61 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789601320.698160:0:5823:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002750355s 00010000:00010000:1.0:1789601320.698162:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abe61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.698168:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abe61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.698172:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abe61 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.698176:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abe61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.698180:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee02045a00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601320.698458:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abe61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.698468:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abe61 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.698489:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abe61 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601320.698563:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abe61 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601320.698572:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abe61 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.698617:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ee02045a00/0xf3d6e402158abe61 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601320.698633:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601320.698701:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2224c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:3317:x1876532880492032:12345-0@lo:103: Request processed in 611us (2271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601320.698708:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789601320.698801:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880492032:0@lo:103: 00000100:00100000:2.0:1789601320.706100:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:7619:x1876532880491776:12345-0@lo:253: Request processed in 44726us (44811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601320.706116:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789601320.706267:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:435644e3-9e9f-44ed-9cfe-21987eda72e5:7619:1876532880491776:0@lo:253: 10000000:01000000:0.0:1789601320.706280:0:7619:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789601320.706282:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789601320.706283:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789601320.706284:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601320.706285:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601320.706286:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601320.706287:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601320.706288:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789601320.706289:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789601320.706290:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789601320.706291:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601320.706292:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789601320.706307:0:7619:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789601320.713606:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789601320.713788:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789601320.714031:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789601320.714150:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789601320.714282:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789601320.715175:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789601320.716216:0:7619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789601320.950722:0:7619:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789601320.950729:0:7619:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789601320.950764:0:7619:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789601320.950821:0:7619:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789601320.950914:0:7619:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789601320.951023:0:7619:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789601320.972980:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601321.993262:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601322.955813:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601322.955853:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880492160:0@lo:13: 00000100:00100000:0.0:1789601322.955933:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601322.956086:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880492160 00000100:00100000:1.0:1789601322.956096:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880492160 00000100:00100000:1.0:1789601322.956166:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601322.956178:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880492160:12345-0@lo:13: 00002000:00000024:1.0:1789601322.956212:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601322.956260:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880492160:12345-0@lo:13: Request processed in 86us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601322.956266:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789601322.956314:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00c6a300 x1876532880492160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789601322.956469:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601322.956611:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880492160:0@lo:13: 00010000:00010000:1.0:1789601323.017987:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601324.041132:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601325.065025:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601326.025214:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880492416:0@lo:400: 00000100:00100000:0.0:1789601326.025314:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601326.025383:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789601326.025390:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880492288:0@lo:400: 00000100:00100000:0.0:1789601326.025426:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601326.025453:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880492800:0@lo:400: 00000100:00100000:0.0:1789601326.025478:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601326.025719:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880492672:0@lo:400: 00000100:00100000:0.0:1789601326.025751:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601326.025773:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601326.025779:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880492544:0@lo:400: 00000100:00100000:0.0:1789601326.025799:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601326.025918:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880492416 00000100:00100000:0.0:1789601326.025928:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880492416 00000100:00100000:0.0:1789601326.025966:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880492800 00000100:00100000:0.0:1789601326.025968:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880492800 00000100:00100000:0.0:1789601326.025989:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880492544 00000100:00100000:0.0:1789601326.025991:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880492544 00000100:00100000:0.0:1789601326.026005:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789601326.026012:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880492416:12345-0@lo:400: 00000100:00100000:0.0:1789601326.026061:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880492416:12345-0@lo:400: Request processed in 49us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601326.026067:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789601326.026082:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789601326.026087:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880492800:12345-0@lo:400: 00000100:00100000:0.0:1789601326.026109:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880492800:12345-0@lo:400: Request processed in 23us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601326.026125:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789601326.026136:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789601326.026141:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880492544:12345-0@lo:400: 00000100:00100000:0.0:1789601326.026169:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880492544:12345-0@lo:400: Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601326.026173:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789601326.026188:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880492288 00000100:00100000:0.0:1789601326.026191:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880492288 00000100:00100000:0.0:1789601326.026208:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789601326.026347:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:3320:x1876532880492288:12345-0@lo:400: 00000100:00100000:0.0:1789601326.026378:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:3320:x1876532880492288:12345-0@lo:400: Request processed in 164us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601326.026384:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789601326.026413:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880492672 00000100:00100000:0.0:1789601326.026416:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880492672 00000100:00100000:0.0:1789601326.026488:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789601326.026495:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880492672:12345-0@lo:400: 00000100:00100000:0.0:1789601326.026599:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880492672:12345-0@lo:400: Request processed in 105us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601326.026605:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789601326.036991:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789601326.037000:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601326.037048:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880492288:0@lo:400: 00010000:00080000:1.0:1789601326.037068:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edd8d90380 x1876532880492800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601326.037081:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880492800:0@lo:400: 00010000:00080000:1.0:1789601326.037092:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edd8d93100 x1876532880492416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601326.037101:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880492416:0@lo:400: 00010000:00080000:0.0:1789601326.037809:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edd8d92d80 x1876532880492544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601326.037822:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880492544:0@lo:400: 00010000:00080000:0.0:1789601326.037833:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edd8d90000 x1876532880492672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601326.037878:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880492672:0@lo:400: 00010000:00010000:3.0:1789601326.090211:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601327.117820:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601328.074144:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880492928:0@lo:13: 00000100:00100000:0.0:1789601328.074229:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601328.074450:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880492928 00000100:00100000:1.0:1789601328.074460:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880492928 00000100:00100000:1.0:1789601328.074517:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789601328.074540:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880492928:12345-0@lo:13: 00002000:00000024:1.0:1789601328.074574:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601328.079927:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880492928:12345-0@lo:13: Request processed in 5380us (5687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601328.079942:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789601328.079989:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789601328.085053:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00c6a300 x1876532880492928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601328.085081:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880492928:0@lo:13: 00010000:00010000:3.0:1789601328.136993:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789601328.222590:0:7975:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789601329.165991:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789601330.121119:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789601330.121127:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91edc825a800 from 30 10000000:01000000:2.0:1789601330.121133:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789601330.121180:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601330.121223:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601330.121237:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601330.121263:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880493056:0@lo:101: 00000100:00100000:2.0:1789601330.121348:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601330.121404:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03da780 going to sleep for 11 seconds 00000100:00100000:3.0:1789601330.121523:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880493056 00000100:00100000:3.0:1789601330.121532:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880493056 00000100:00100000:3.0:1789601330.121586:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789601330.121597:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:5834:x1876532880493056:12345-0@lo:101: 00010000:00010000:3.0:1789601330.121611:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601330.121625:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ee02044a00/0xf3d6e402158abe6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abe68 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601330.121648:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ee02044a00/0xf3d6e402158abe6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abe68 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601330.121658:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ee02044a00/0xf3d6e402158abe6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abe68 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601330.121666:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee02044a00, rc 0) 00000100:00100000:3.0:1789601330.121716:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:5834:x1876532880493056:12345-0@lo:101: Request processed in 120us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601330.121723:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789601330.121924:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880493056:0@lo:101: 00010000:00010000:2.0:1789601330.121939:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601330.121948:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abe6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601330.122079:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880493184:0@lo:501: 00000100:00100000:2.0:1789601330.122113:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601330.122143:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03da780 going to sleep for 11 seconds 00000100:00100000:1.0:1789601330.122255:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880493184 00000100:00100000:1.0:1789601330.122260:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880493184 00000100:00100000:1.0:1789601330.122295:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789601330.122303:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:5834:x1876532880493184:12345-0@lo:501: 00000100:00100000:1.0:1789601330.122791:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:5834:x1876532880493184:12345-0@lo:501: Request processed in 488us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601330.122799:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789601330.123024:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880493184:0@lo:501: 00000100:00100000:2.0:1789601330.123060:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880493312:0@lo:503: 00000100:00100000:2.0:1789601330.123102:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601330.123131:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03da780 going to sleep for 11 seconds 00000100:00100000:0.0:1789601330.123187:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880493312 00000100:00100000:0.0:1789601330.123193:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880493312 00000100:00100000:0.0:1789601330.123238:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789601330.123247:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:5834:x1876532880493312:12345-0@lo:503: 00000100:00100000:0.0:1789601330.123618:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:5834:x1876532880493312:12345-0@lo:503: Request processed in 371us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601330.123625:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789601330.123712:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880493312:0@lo:503: 00000100:00100000:1.0:1789601330.124909:0:8058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8058:1876532880493440:0@lo:502: 00000100:00100000:1.0:1789601330.124998:0:8058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601330.125036:0:8058:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc50bb600 going to sleep for 11 seconds 00000100:00100000:2.0:1789601330.125098:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880493440 00000100:00100000:2.0:1789601330.125110:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880493440 00000100:00100000:2.0:1789601330.125142:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789601330.125149:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:8058:x1876532880493440:12345-0@lo:502: 00000100:00100000:2.0:1789601330.125577:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:8058:x1876532880493440:12345-0@lo:502: Request processed in 424us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601330.125584:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789601330.126067:0:8058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8058:1876532880493440:0@lo:502: 00000100:00100000:1.0:1789601330.126124:0:8058:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8058:1876532880493568:0@lo:502: 00000100:00100000:1.0:1789601330.126181:0:8058:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601330.126220:0:8058:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc50bb600 going to sleep for 11 seconds 00000100:00100000:3.0:1789601330.126341:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880493568 00000100:00100000:3.0:1789601330.126350:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880493568 00000100:00100000:3.0:1789601330.126394:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789601330.126406:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:8058:x1876532880493568:12345-0@lo:502: 00000100:00100000:3.0:1789601330.126644:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:8058:x1876532880493568:12345-0@lo:502: Request processed in 240us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601330.126657:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789601330.126887:0:8058:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8058:1876532880493568:0@lo:502: 00000040:00080000:1.0:1789601330.126921:0:8058:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789601330.127106:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789601330.127126:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789601330.127142:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601330.127156:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601330.127169:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789601330.127172:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789601330.127175:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789601330.127212:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5a00/0xf3d6e402158abe76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601330.127221:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc29c5a00/0xf3d6e402158abe76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601330.127232:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc29c5a00/0xf3d6e402158abe76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601330.127250:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880493696:0@lo:101: 00000100:00100000:2.0:1789601330.127291:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601330.127315:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03dacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601330.127460:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880493696 00000100:00100000:0.0:1789601330.127467:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880493696 00000100:00100000:0.0:1789601330.127496:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789601330.127503:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:5834:x1876532880493696:12345-0@lo:101: 00010000:00010000:0.0:1789601330.127513:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601330.127525:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc0030c00/0xf3d6e402158abe7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abe76 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601330.127545:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc0030c00/0xf3d6e402158abe7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abe76 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601330.127555:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc0030c00/0xf3d6e402158abe7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abe76 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601330.127574:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc0030c00, rc 0) 00000100:00100000:0.0:1789601330.127615:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:5834:x1876532880493696:12345-0@lo:101: Request processed in 113us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601330.127621:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789601330.127767:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880493696:0@lo:101: 00010000:00010000:2.0:1789601330.127797:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc29c5a00/0xf3d6e402158abe76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe7d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601330.127809:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc29c5a00/0xf3d6e402158abe76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abe7d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601330.127902:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880493824:0@lo:501: 00000100:00100000:2.0:1789601330.127938:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601330.127969:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03dacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601330.128111:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880493824 00000100:00100000:1.0:1789601330.128117:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880493824 00000100:00100000:1.0:1789601330.128148:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789601330.128160:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:5834:x1876532880493824:12345-0@lo:501: 00000100:00100000:1.0:1789601330.128552:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:5834:x1876532880493824:12345-0@lo:501: Request processed in 394us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601330.128560:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789601330.128625:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880493824:0@lo:501: 00000100:00100000:2.0:1789601330.128651:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880493952:0@lo:503: 00000100:00100000:2.0:1789601330.128690:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601330.128717:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03dacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601330.128763:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880493952 00000100:00100000:3.0:1789601330.128773:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880493952 00000100:00100000:3.0:1789601330.128808:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789601330.128828:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:5834:x1876532880493952:12345-0@lo:503: 00000100:00100000:3.0:1789601330.129174:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:5834:x1876532880493952:12345-0@lo:503: Request processed in 346us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601330.129181:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789601330.129342:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880493952:0@lo:503: 00000100:00100000:2.0:1789601330.129799:0:8059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8059:1876532880494080:0@lo:502: 00000100:00100000:2.0:1789601330.129872:0:8059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601330.129899:0:8059:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03da900 going to sleep for 11 seconds 00000100:00100000:1.0:1789601330.129986:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880494080 00000100:00100000:1.0:1789601330.129990:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880494080 00000100:00100000:1.0:1789601330.130022:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789601330.130030:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:8059:x1876532880494080:12345-0@lo:502: 00000100:00100000:1.0:1789601330.130247:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:8059:x1876532880494080:12345-0@lo:502: Request processed in 218us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601330.130254:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789601330.130341:0:8059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8059:1876532880494080:0@lo:502: 00000020:01000000:2.0:1789601330.130366:0:8059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601330.130376:0:8059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601330.130379:0:8059:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789601330.130384:0:8059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789601330.130386:0:8059:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789601330.130409:0:8059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8059:1876532880494208:0@lo:502: 00000100:00100000:2.0:1789601330.130440:0:8059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601330.130505:0:8059:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03da900 going to sleep for 11 seconds 00000100:00100000:0.0:1789601330.132256:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880494208 00000100:00100000:0.0:1789601330.132271:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880494208 00000100:00100000:0.0:1789601330.132336:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789601330.132346:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:8059:x1876532880494208:12345-0@lo:502: 00000100:00100000:0.0:1789601330.132602:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:8059:x1876532880494208:12345-0@lo:502: Request processed in 256us (2161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601330.132609:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789601330.134486:0:8059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8059:1876532880494208:0@lo:502: 00000020:01000000:2.0:1789601330.134537:0:8059:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601330.134550:0:8059:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601330.134553:0:8059:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789601330.134558:0:8059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1789601330.134747:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1789601330.134766:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789601330.134777:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5a00/0xf3d6e402158abe76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe7d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601330.134789:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc29c5a00/0xf3d6e402158abe76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe7d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601330.134799:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789601330.134802:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91edd1466000 from 30 10000000:01000000:1.0:1789601330.134804:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789601330.134881:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abe84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601330.134890:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abe84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601330.134900:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abe84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601330.134921:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880494336:0@lo:101: 00000100:00100000:1.0:1789601330.134988:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601330.135021:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc50bbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601330.135092:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880494336 00000100:00100000:3.0:1789601330.135099:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880494336 00000100:00100000:3.0:1789601330.135147:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789601330.135156:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:5834:x1876532880494336:12345-0@lo:101: 00010000:00010000:3.0:1789601330.135169:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601330.135182:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ee02044600/0xf3d6e402158abe8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abe84 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601330.135216:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ee02044600/0xf3d6e402158abe8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abe84 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601330.135227:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ee02044600/0xf3d6e402158abe8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abe84 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601330.135236:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee02044600, rc 0) 00000100:00100000:3.0:1789601330.135278:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:5834:x1876532880494336:12345-0@lo:101: Request processed in 124us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601330.135285:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789601330.135467:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880494336:0@lo:101: 00010000:00010000:2.0:1789601330.135480:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abe84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe8b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601330.135488:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abe84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abe8b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601330.135535:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880494464:0@lo:501: 00000100:00100000:2.0:1789601330.135561:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601330.135588:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03da900 going to sleep for 11 seconds 00000100:00100000:0.0:1789601330.135645:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880494464 00000100:00100000:0.0:1789601330.135650:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880494464 00000100:00100000:0.0:1789601330.135683:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789601330.135689:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:5834:x1876532880494464:12345-0@lo:501: 00000100:00100000:0.0:1789601330.135974:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:5834:x1876532880494464:12345-0@lo:501: Request processed in 284us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601330.135981:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789601330.136115:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880494464:0@lo:501: 00000100:00100000:2.0:1789601330.136141:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880494592:0@lo:503: 00000100:00100000:2.0:1789601330.136179:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601330.136197:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03da900 going to sleep for 11 seconds 00000100:00100000:0.0:1789601330.136412:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880494592 00000100:00100000:0.0:1789601330.136418:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880494592 00000100:00100000:0.0:1789601330.138296:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789601330.138318:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:5834:x1876532880494592:12345-0@lo:503: 00000100:00100000:0.0:1789601330.138568:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:5834:x1876532880494592:12345-0@lo:503: Request processed in 259us (2387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601330.138576:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789601330.138712:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880494592:0@lo:503: 00000100:00100000:2.0:1789601330.141695:0:8060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8060:1876532880494720:0@lo:502: 00000100:00100000:2.0:1789601330.141779:0:8060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601330.154414:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880494720 00000100:00100000:1.0:1789601330.154431:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880494720 00000100:00100000:1.0:1789601330.154493:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789601330.154504:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:8060:x1876532880494720:12345-0@lo:502: 00000100:00100000:1.0:1789601330.154819:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:8060:x1876532880494720:12345-0@lo:502: Request processed in 317us (13038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601330.154826:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789601330.157049:0:8060:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03da480 going to sleep for 11 seconds 00000100:00100000:2.0:1789601330.157099:0:8060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8060:1876532880494720:0@lo:502: 00000100:00100000:2.0:1789601330.157185:0:8060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8060:1876532880494848:0@lo:502: 00000100:00100000:2.0:1789601330.157291:0:8060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601330.157319:0:8060:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03da480 going to sleep for 11 seconds 00000100:00100000:1.0:1789601330.157418:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880494848 00000100:00100000:1.0:1789601330.157425:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880494848 00000100:00100000:1.0:1789601330.157463:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789601330.157470:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:8060:x1876532880494848:12345-0@lo:502: 00000100:00100000:1.0:1789601330.157708:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:8060:x1876532880494848:12345-0@lo:502: Request processed in 238us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601330.157716:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789601330.157785:0:8060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8060:1876532880494848:0@lo:502: 00000040:00080000:2.0:1789601330.157805:0:8060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789601330.158001:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789601330.158020:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789601330.158030:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abe84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe8b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601330.158041:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abe84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe8b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601330.158052:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789601330.158055:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91edd1466000 from 5 10000000:01000000:1.0:1789601330.158057:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789601330.158085:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abe92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601330.158094:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abe92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601330.158102:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abe92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601330.158127:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880494976:0@lo:101: 00000100:00100000:1.0:1789601330.158156:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601330.158189:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc50bb180 going to sleep for 11 seconds 00000100:00100000:2.0:1789601330.159512:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880494976 00000100:00100000:2.0:1789601330.159525:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880494976 00000100:00100000:2.0:1789601330.159566:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789601330.159575:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:5834:x1876532880494976:12345-0@lo:101: 00010000:00010000:2.0:1789601330.159590:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601330.159606:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc29c4600/0xf3d6e402158abe99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abe92 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601330.159630:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c4600/0xf3d6e402158abe99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abe92 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601330.159641:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc29c4600/0xf3d6e402158abe99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abe92 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601330.159649:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c4600, rc 0) 00000100:00100000:2.0:1789601330.159723:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880494976:12345-0@lo:101: Request processed in 149us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601330.159729:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789601330.160453:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880494976:0@lo:101: 00010000:00010000:1.0:1789601330.160472:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abe92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601330.161444:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abe92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abe99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601330.161545:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880495104:0@lo:256: 00000100:00100000:1.0:1789601330.161609:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601330.161643:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc50bb180 going to sleep for 11 seconds 00000100:00100000:2.0:1789601330.161737:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880495104 00000100:00100000:2.0:1789601330.161743:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880495104 00000100:00100000:2.0:1789601330.161776:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789601330.161784:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880495104:12345-0@lo:256: 20000000:01000000:2.0:1789601330.161803:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789601330.161820:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789601330.161827:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789601330.161938:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880495104:12345-0@lo:256: Request processed in 154us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601330.161945:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789601330.162026:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880495104:0@lo:256: 10000000:01000000:1.0:1789601330.162074:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789601330.162082:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abe92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601330.162091:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abe92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601330.162101:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789601330.162103:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789601330.162106:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789601330.162128:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b88e00/0xf3d6e402158abea0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601330.162145:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc3b88e00/0xf3d6e402158abea0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601330.162155:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc3b88e00/0xf3d6e402158abea0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601330.162167:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880495232:0@lo:101: 00000100:00100000:1.0:1789601330.162191:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601330.162225:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc50bb180 going to sleep for 11 seconds 00000100:00100000:2.0:1789601330.162265:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880495232 00000100:00100000:2.0:1789601330.162269:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880495232 00000100:00100000:2.0:1789601330.162286:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789601330.162293:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880495232:12345-0@lo:101: 00010000:00010000:2.0:1789601330.162301:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601330.162312:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc29c5400/0xf3d6e402158abea7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abea0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601330.162344:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c5400/0xf3d6e402158abea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abea0 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601330.162354:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc29c5400/0xf3d6e402158abea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abea0 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601330.162362:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c5400, rc 0) 00000100:00100000:2.0:1789601330.162399:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880495232:12345-0@lo:101: Request processed in 107us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601330.162405:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789601330.162525:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880495232:0@lo:101: 00010000:00010000:1.0:1789601330.162536:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc3b88e00/0xf3d6e402158abea0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abea7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601330.162544:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc3b88e00/0xf3d6e402158abea0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abea7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601330.162587:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880495360:0@lo:501: 00000100:00100000:1.0:1789601330.162611:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601330.162634:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc50bb180 going to sleep for 11 seconds 00000100:00100000:2.0:1789601330.162712:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880495360 00000100:00100000:2.0:1789601330.162717:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880495360 00000100:00100000:2.0:1789601330.162735:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789601330.162741:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880495360:12345-0@lo:501: 00000100:00100000:2.0:1789601330.163017:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880495360:12345-0@lo:501: Request processed in 275us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601330.163024:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789601330.164482:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880495360:0@lo:501: 00000100:00100000:1.0:1789601330.164532:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880495488:0@lo:503: 00000100:00100000:1.0:1789601330.164591:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601330.164625:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc50bb180 going to sleep for 11 seconds 00000100:00100000:3.0:1789601330.164863:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880495488 00000100:00100000:3.0:1789601330.164869:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880495488 00000100:00100000:3.0:1789601330.164903:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789601330.164910:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880495488:12345-0@lo:503: 00000100:00100000:3.0:1789601330.165251:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880495488:12345-0@lo:503: Request processed in 340us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601330.165266:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789601330.165500:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880495488:0@lo:503: 00000100:00100000:1.0:1789601330.174714:0:8061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c68e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8061:1876532880495616:0@lo:502: 00000100:00100000:1.0:1789601330.174815:0:8061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601330.174886:0:8061:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc50bbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601330.174942:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880495616 00000100:00100000:3.0:1789601330.174951:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880495616 00000100:00100000:3.0:1789601330.175003:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789601330.175012:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:8061:x1876532880495616:12345-0@lo:502: 00000100:00100000:3.0:1789601330.175360:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:8061:x1876532880495616:12345-0@lo:502: Request processed in 349us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601330.175369:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789601330.175524:0:8061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c68e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8061:1876532880495616:0@lo:502: 00000020:01000000:1.0:1789601330.175555:0:8061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789601330.175564:0:8061:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789601330.175570:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601330.175572:0:8061:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789601330.175580:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789601330.175583:0:8061:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:1.0:1789601330.175606:0:8061:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789601330.175608:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789601330.175623:0:8061:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91edc6014d40) 00000020:00000080:1.0:1789601330.175646:0:8061:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789601330.175652:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789601330.175723:0:8061:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789601330.175729:0:8061:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789601330.175746:0:8061:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3d6e402158abeb5 00010000:00080000:1.0:1789601330.175773:0:8061:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91edf8ac5000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:1.0:1789601330.176059:0:8061:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1789601330.176465:0:8061:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789601330.176478:0:8061:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789601330.177015:0:8061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789601330.177243:0:8061:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789601330.177296:0:8061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789601330.179819:0:8061:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789601330.182479:0:8063:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789601330.182495:0:8063:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789601330.184454:0:8061:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789601330.184468:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789601330.184515:0:8061:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789601330.184538:0:8061:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3d6e402158abebc 00000100:00080000:3.0:1789601330.184549:0:8061:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789601330.184562:0:8061:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91edf8ac5000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1789601330.184601:0:8061:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91edd8de8000 x1876532880495744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789601330.184668:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880495744:0@lo:8: 00000100:00100000:1.0:1789601330.184741:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789601330.187430:0:8061:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789601330.187612:0:8061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601330.187619:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601330.187622:0:8061:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789601330.187626:0:8061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601330.187631:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601330.187632:0:8061:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789601330.187635:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789601330.187638:0:8061:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789601330.187666:0:8061:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8dead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8061:1876532880496384:0@lo:502: 00000100:00100000:3.0:1789601330.187751:0:8061:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601330.187789:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880496384 00000100:00100000:3.0:1789601330.187803:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880496384 00000100:00100000:3.0:1789601330.187871:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789601330.187880:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:8061:x1876532880496384:12345-0@lo:502: 00000100:00100000:3.0:1789601330.188114:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:8061:x1876532880496384:12345-0@lo:502: Request processed in 235us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601330.188123:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789601330.188163:0:8061:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8a71cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601330.188184:0:8061:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8dead80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8061:1876532880496384:0@lo:502: 00000020:01000000:3.0:1789601330.188225:0:8061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601330.188229:0:8061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601330.188231:0:8061:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789601330.188234:0:8061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1789601330.188286:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1789601330.188302:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789601330.188310:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b88e00/0xf3d6e402158abea0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abea7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601330.188461:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8dea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880496000:0@lo:400: 00000100:00100000:0.0:1789601330.188496:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601330.188522:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601330.188528:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880495872:0@lo:400: 00000100:00100000:0.0:1789601330.188549:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601330.188574:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880496256:0@lo:400: 00000100:00100000:0.0:1789601330.188596:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601330.188613:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789601330.188619:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880496128:0@lo:400: 00000100:00100000:0.0:1789601330.188641:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601330.188676:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880496000 00000100:00100000:0.0:1789601330.188679:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880496000 00000100:00100000:0.0:1789601330.188710:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880495872 00000100:00100000:0.0:1789601330.188713:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880495872 00000100:00100000:0.0:1789601330.188725:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880496256 00000100:00100000:0.0:1789601330.188727:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880496256 00000100:00100000:0.0:1789601330.188739:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789601330.188745:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880496000:12345-0@lo:400: 00000100:00100000:0.0:1789601330.188781:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880496000:12345-0@lo:400: Request processed in 36us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601330.188787:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789601330.188800:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789601330.188806:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880495872:12345-0@lo:400: 00000100:00100000:0.0:1789601330.188832:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880495872:12345-0@lo:400: Request processed in 26us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601330.188857:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789601330.188877:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789601330.188883:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880496256:12345-0@lo:400: 00000100:00100000:0.0:1789601330.188914:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880496256:12345-0@lo:400: Request processed in 32us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601330.188920:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789601330.188939:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880495744 00000100:00100000:0.0:1789601330.188944:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880495744 00000100:00100000:0.0:1789601330.188960:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880496128 00000100:00100000:0.0:1789601330.188963:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880496128 00000100:00100000:0.0:1789601330.188980:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789601330.188986:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880496128:12345-0@lo:400: 00000100:00100000:0.0:1789601330.189016:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880496128:12345-0@lo:400: Request processed in 30us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601330.189021:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789601330.189032:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789601330.189035:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3316:x1876532880495744:12345-0@lo:8: 00010000:00080000:0.0:1789601330.189055:0:6677:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:0.0:1789601330.189083:0:6677:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3d6e402158abec3 00002000:00100000:0.0:1789601330.189095:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91edffe9d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789601330.189098:0:6677:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1789601330.189102:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789601330.189228:0:6677:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789601330.189401:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789601330.189429:0:6677:0:(import.c:65:import_set_state_nolock()) ffff91edffe9c800 : changing import state from RECOVER to FULL 00010000:00010000:3.0:1789601330.190432:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc3b88e00/0xf3d6e402158abea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abea7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601330.190454:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789601330.190457:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91edc6010000 from 1 10000000:01000000:3.0:1789601330.190460:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789601330.190499:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abeca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601330.190508:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abeca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601330.190518:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abeca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601330.190562:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8dead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880496512:0@lo:101: 00000100:00100000:3.0:1789601330.190621:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601330.190663:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8a71cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601330.196401:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880496512 00000100:00100000:3.0:1789601330.196420:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880496512 00000100:00100000:3.0:1789601330.196476:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789601330.196487:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880496512:12345-0@lo:101: 00010000:00010000:3.0:1789601330.196504:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601330.196523:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ee02045400/0xf3d6e402158abed1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abeca expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601330.196553:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ee02045400/0xf3d6e402158abed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abeca expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601330.196565:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ee02045400/0xf3d6e402158abed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abeca expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601330.196574:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee02045400, rc 0) 00000100:00100000:3.0:1789601330.196651:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880496512:12345-0@lo:101: Request processed in 166us (6030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601330.196658:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789601330.196726:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8dead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880496512:0@lo:101: 00010000:00010000:3.0:1789601330.196743:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abeca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abed1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601330.196752:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abeca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abed1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601330.196855:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8dead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880496640:0@lo:501: 00000100:00100000:3.0:1789601330.196889:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601330.196908:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8a71cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601330.196920:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880496640 00000100:00100000:3.0:1789601330.196924:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880496640 00000100:00100000:3.0:1789601330.196939:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789601330.196944:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880496640:12345-0@lo:501: 00000100:00100000:3.0:1789601330.197165:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880496640:12345-0@lo:501: Request processed in 219us (275us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789601330.197173:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789601330.197215:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8dead80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880496640:0@lo:501: 10000000:01000000:3.0:1789601330.197239:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789601330.197245:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abeca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abed1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601330.197253:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abeca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abed1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789601330.197419:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789601330.197426:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789601330.197498:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601330.197558:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3316:x1876532880495744:12345-0@lo:8: Request processed in 8518us (12814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601330.197567:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789601330.197640:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edd8de9880 x1876532880496128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601330.197652:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8de9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880496128:0@lo:400: 00010000:00080000:0.0:1789601330.197666:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edd8dea680 x1876532880496256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601330.197675:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8dea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880496256:0@lo:400: 00010000:00080000:0.0:1789601330.197706:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edd8de9500 x1876532880495872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601330.197715:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8de9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880495872:0@lo:400: 00010000:00080000:0.0:1789601330.197729:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edd8dea300 x1876532880496000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601330.197736:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8dea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880496000:0@lo:400: 00010000:00080000:1.0:1789601330.201499:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edd8de8000 x1876532880495744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789601340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601330.201525:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789601330.201537:0:3316:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789601330.201547:0:3316:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789601330.201553:0:3316:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789601330.201557:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91edf8ac5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789601330.201582:0:3316:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789601330.201588:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880495744:0@lo:8: 00000004:00080000:0.0:1789601330.201684:0:8063:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789601330.201827:0:8063:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 200239989763ns, next at 0ns, rc = 0 00000004:00080000:3.0:1789601330.297263:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1789601330.382831:0:8064:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789601330.382887:0:8064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d91500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1876532880496896:0@lo:7: 00000100:00100000:0.0:1789601330.382967:0:8064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601330.383014:0:8064:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc53866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601330.383041:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880496768:0@lo:13: 00000100:00100000:0.0:1789601330.383067:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601330.383108:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880496896 00000100:00100000:0.0:1789601330.383115:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880496896 00000100:00100000:0.0:1789601330.383169:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789601330.383179:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc7048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8064:x1876532880496896:12345-0@lo:7: 00000100:00080000:1.0:1789601330.389961:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601330.389989:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880496768 00000100:00100000:1.0:1789601330.389999:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880496768 00000100:00100000:1.0:1789601330.390055:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789601330.390066:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc704b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1876532880496768:12345-0@lo:13: 00002000:00000024:1.0:1789601330.390098:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789601330.390186:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc704b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1876532880496768:12345-0@lo:13: Request processed in 122us (7117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601330.390195:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789601330.399367:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edd8d90380 x1876532880496768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601330.399398:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880496768:0@lo:13: 00002000:00080000:0.0:1789601330.402218:0:6676:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789601330.402226:0:6676:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789601330.402332:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc7048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8064:x1876532880496896:12345-0@lo:7: Request processed in 19150us (19360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601330.402343:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789601330.402986:0:8064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edd8d91500 x1876532880496896/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789601346 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601330.403005:0:8064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d91500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1876532880496896:0@lo:7: 00000004:00080000:2.0:1789601330.403020:0:8064:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789601330.403061:0:8064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1876532880497024:0@lo:5: 00000100:00100000:2.0:1789601330.403101:0:8064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601330.403148:0:8064:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03dab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601330.403221:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880497024 00000100:00100000:1.0:1789601330.403229:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880497024 00000100:00100000:1.0:1789601330.403278:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789601330.403288:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8064:x1876532880497024:12345-0@lo:5: 00002000:00080000:1.0:1789601330.403314:0:6679:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789601330.403318:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789601330.403592:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8064:x1876532880497024:12345-0@lo:5: Request processed in 305us (490us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789601330.403608:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789601330.403689:0:8064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00c83800 x1876532880497024/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789601346 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601330.403702:0:8064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1876532880497024:0@lo:5: 00000004:00080000:2.0:1789601330.403712:0:8064:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789601330.403736:0:8064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1876532880497152:0@lo:700: 00000100:00100000:2.0:1789601330.403763:0:8064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601330.403789:0:8064:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03dab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601330.407368:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880497152 00000100:00100000:3.0:1789601330.407385:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880497152 00000100:00100000:3.0:1789601330.407457:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789601330.407468:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8064:x1876532880497152:12345-0@lo:700: 00000100:00100000:3.0:1789601330.407529:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8dead80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1876532880497280:0@lo:700: 00000100:00100000:3.0:1789601330.407610:0:6685:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601330.407648:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc7951840 going to sleep for 11 seconds 00000100:00100000:3.0:1789601330.407665:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880497280 00000100:00100000:3.0:1789601330.407669:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880497280 00000100:00100000:3.0:1789601330.407695:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789601330.407701:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1876532880497280:12345-0@lo:700: 40000000:02000000:3.0:1789601330.478985:0:5844:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1789601330.488094:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1876532880497280:12345-0@lo:700: Request processed in 80382us (80474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601330.488111:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789601330.488336:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edd8dead80 x1876532880497280/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789601346 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601330.488352:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8dead80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1876532880497280:0@lo:700: 40000000:02000000:2.0:1789601330.488366:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:3.0:1789601330.593962:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789601330.593983:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1789601330.594156:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8064:x1876532880497152:12345-0@lo:700: Request processed in 186685us (190386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601330.594175:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789601330.594346:0:8064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00c82680 x1876532880497152/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789601346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601330.594358:0:8064:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789601330.594375:0:8064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c82680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1876532880497152:0@lo:700: 00000004:02000040:3.0:1789601330.633944:0:8064:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1789601330.637128:0:8064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8deaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1876532880497408:0@lo:5: 00000100:00100000:3.0:1789601330.643795:0:8064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601330.643931:0:8064:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc7951600 going to sleep for 11 seconds 00000100:00100000:0.0:1789601330.646456:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880497408 00000100:00100000:0.0:1789601330.646472:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880497408 00000100:00100000:0.0:1789601330.646612:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789601330.646624:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8064:x1876532880497408:12345-0@lo:5: 00002000:00080000:2.0:1789601330.668744:0:6676:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789601330.668766:0:6676:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789601330.681583:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8de8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8064:x1876532880497408:12345-0@lo:5: Request processed in 34952us (44380us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789601330.681596:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789601330.681721:0:8064:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edd8deaa00 x1876532880497408/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789601346 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601330.681742:0:8064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8deaa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8064:1876532880497408:0@lo:5: 00000004:00080000:0.0:1789601330.681757:0:8064:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1789601331.209086:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601332.236511:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601333.194480:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601333.194509:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880497536:0@lo:13: 00000100:00100000:2.0:1789601333.194604:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601333.194773:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880497536 00000100:00100000:1.0:1789601333.194784:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880497536 00000100:00100000:1.0:1789601333.194890:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789601333.194901:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880497536:12345-0@lo:13: 00002000:00000024:1.0:1789601333.195137:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601333.195380:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880497536:12345-0@lo:13: Request processed in 481us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601333.195388:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789601333.195482:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00c6b800 x1876532880497536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601333.195504:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880497536:0@lo:13: 00000100:00080000:0.0:1789601333.197102:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789601333.269751:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789601334.025238:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1789601334.294206:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601334.667030:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601334.667454:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858454144 00000100:00100000:0.0:1789601334.667466:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858454144 00000100:00100000:0.0:1789601334.667513:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 110 00000100:00100000:0.0:1789601334.667531:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2355:x1876532858454144:12345-192.168.201.30@tcp:250: 00010000:00080000:0.0:1789601334.667561:0:5831:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 40e96c7a-a5b4-4553-9a17-8e4644c4cf0e@192.168.201.30@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:0.0:1789601334.667594:0:5831:0:(genops.c:1384:class_connect()) connect: client 40e96c7a-a5b4-4553-9a17-8e4644c4cf0e, cookie 0xf3d6e402158abed8 00000100:00080000:0.0:1789601334.667747:0:5831:0:(import.c:65:import_set_state_nolock()) ffff91edffe9b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601334.667813:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+5:2355:x1876532858454144:12345-192.168.201.30@tcp:250: Request processed in 290us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601334.667821:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 110 00000100:00100000:0.0:1789601334.677483:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601334.678532:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858454272 00000100:00100000:2.0:1789601334.678544:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858454272 00000100:00100000:2.0:1789601334.678613:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00100000:2.0:1789601334.678624:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+5:5585:x1876532858454272:12345-192.168.201.30@tcp:101: 00010000:00010000:2.0:1789601334.678639:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601334.678656:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc29c5600/0xf3d6e402158abedf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f5060efa expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601334.678820:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c5600/0xf3d6e402158abedf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060efa expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601334.678832:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc29c5600/0xf3d6e402158abedf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060efa expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601334.678869:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c5600, rc 0) 00000100:00100000:2.0:1789601334.678924:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+6:5585:x1876532858454272:12345-192.168.201.30@tcp:101: Request processed in 302us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601334.678931:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00100000:2.0:1789601334.686952:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601334.687042:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858454400 00000100:00100000:1.0:1789601334.687051:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858454400 00000100:00100000:1.0:1789601334.687109:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 112 00000100:00100000:1.0:1789601334.687128:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+6:5585:x1876532858454400:12345-192.168.201.30@tcp:501: 00000100:00100000:1.0:1789601334.687509:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+6:5585:x1876532858454400:12345-192.168.201.30@tcp:501: Request processed in 389us (565us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789601334.687517:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 112 00000100:00100000:2.0:1789601334.690609:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601334.690715:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858454528 00000100:00100000:0.0:1789601334.690739:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858454528 00000100:00100000:0.0:1789601334.690798:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 113 00000100:00100000:0.0:1789601334.690807:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+6:5585:x1876532858454528:12345-192.168.201.30@tcp:101: 00010000:00010000:0.0:1789601334.690825:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601334.690869:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc0030e00/0xf3d6e402158abee6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f5060f01 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601334.690899:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc0030e00/0xf3d6e402158abee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f01 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601334.690910:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc0030e00/0xf3d6e402158abee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f01 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601334.690918:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc0030e00, rc 0) 00000100:00100000:0.0:1789601334.690969:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+7:5585:x1876532858454528:12345-192.168.201.30@tcp:101: Request processed in 164us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601334.690976:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 113 00000100:00100000:0.0:1789601334.699641:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601334.699821:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858454656 00000100:00100000:3.0:1789601334.699863:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858454656 00000100:00100000:3.0:1789601334.704529:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 114 00000100:00100000:3.0:1789601334.704548:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+7:5585:x1876532858454656:12345-192.168.201.30@tcp:501: 00000100:00100000:3.0:1789601334.704832:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+8:5585:x1876532858454656:12345-192.168.201.30@tcp:501: Request processed in 290us (5201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601334.704855:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 114 00000100:00100000:3.0:1789601334.707282:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601334.707313:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858454784 00000100:00100000:3.0:1789601334.707321:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858454784 00000100:00100000:3.0:1789601334.707359:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00100000:3.0:1789601334.707367:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+8:5585:x1876532858454784:12345-192.168.201.30@tcp:503: 00000100:00100000:3.0:1789601334.707721:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+8:5585:x1876532858454784:12345-192.168.201.30@tcp:503: Request processed in 353us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601334.707729:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00100000:3.0:1789601334.713168:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601334.713316:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858454912 00000100:00100000:2.0:1789601334.713339:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858454912 00000100:00100000:2.0:1789601334.713395:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 116 00000100:00100000:2.0:1789601334.713405:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+8:5603:x1876532858454912:12345-192.168.201.30@tcp:502: 00000100:00100000:2.0:1789601334.714029:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+8:5603:x1876532858454912:12345-192.168.201.30@tcp:502: Request processed in 623us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601334.714038:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 116 00000100:00100000:3.0:1789601334.750693:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601334.750831:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858455040 00000100:00100000:1.0:1789601334.750865:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858455040 00000100:00100000:1.0:1789601334.750926:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 117 00000100:00100000:1.0:1789601334.750937:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+8:5603:x1876532858455040:12345-192.168.201.30@tcp:502: 00000100:00100000:1.0:1789601334.751224:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+8:5603:x1876532858455040:12345-192.168.201.30@tcp:502: Request processed in 287us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601334.751231:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 117 00000100:00100000:3.0:1789601334.760212:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601334.760255:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858455168 00000100:00100000:3.0:1789601334.760265:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858455168 00000100:00100000:3.0:1789601334.760310:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 118 00000100:00100000:3.0:1789601334.760319:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+8:5585:x1876532858455168:12345-192.168.201.30@tcp:101: 00010000:00010000:3.0:1789601334.760336:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601334.760353:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ee02045800/0xf3d6e402158abeed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f5060f2b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601334.760379:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ee02045800/0xf3d6e402158abeed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f2b expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601334.760407:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ee02045800/0xf3d6e402158abeed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f2b expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601334.760417:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee02045800, rc 0) 00000100:00100000:3.0:1789601334.760465:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+9:5585:x1876532858455168:12345-192.168.201.30@tcp:101: Request processed in 147us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601334.760472:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 118 00000100:00100000:3.0:1789601334.780870:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601334.780907:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858455296 00000100:00100000:3.0:1789601334.780916:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858455296 00000100:00100000:3.0:1789601334.780962:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 119 00000100:00100000:3.0:1789601334.780972:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+9:5585:x1876532858455296:12345-192.168.201.30@tcp:256: 20000000:01000000:3.0:1789601334.780995:0:5832:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789601334.781016:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789601334.781021:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789601334.781024:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789601334.781026:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1789601334.783193:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+9:5585:x1876532858455296:12345-192.168.201.30@tcp:256: Request processed in 2213us (2324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601334.783207:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 119 00000100:00100000:3.0:1789601334.787275:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601334.787386:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858455424 00000100:00100000:0.0:1789601334.787396:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858455424 00000100:00100000:0.0:1789601334.787451:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00100000:0.0:1789601334.787462:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+9:5585:x1876532858455424:12345-192.168.201.30@tcp:101: 00010000:00010000:0.0:1789601334.787478:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601334.787496:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc0030800/0xf3d6e402158abef4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f5060f32 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601334.787523:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc0030800/0xf3d6e402158abef4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f32 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601334.787553:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc0030800/0xf3d6e402158abef4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f32 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601334.787562:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc0030800, rc 0) 00000100:00100000:0.0:1789601334.787614:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:5585:x1876532858455424:12345-192.168.201.30@tcp:101: Request processed in 154us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601334.787620:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00100000:1.0:1789601334.792414:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601334.792530:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858455552 00000100:00100000:3.0:1789601334.792541:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858455552 00000100:00100000:3.0:1789601334.792603:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 121 00000100:00100000:3.0:1789601334.792613:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:5585:x1876532858455552:12345-192.168.201.30@tcp:501: 00000100:00100000:3.0:1789601334.792928:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:5585:x1876532858455552:12345-192.168.201.30@tcp:501: Request processed in 316us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601334.792941:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 121 00000100:00100000:2.0:1789601334.798577:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601334.798644:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858455680 00000100:00100000:0.0:1789601334.798655:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858455680 00000100:00100000:0.0:1789601334.798704:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 122 00000100:00100000:0.0:1789601334.798713:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:5585:x1876532858455680:12345-192.168.201.30@tcp:503: 00000100:00100000:0.0:1789601334.799142:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:5585:x1876532858455680:12345-192.168.201.30@tcp:503: Request processed in 427us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601334.799150:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 122 00000100:00100000:3.0:1789601334.813329:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601334.813707:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858455808 00000100:00100000:1.0:1789601334.813717:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858455808 00000100:00100000:1.0:1789601334.813767:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 123 00000100:00100000:1.0:1789601334.813777:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:5607:x1876532858455808:12345-192.168.201.30@tcp:502: 00000100:00100000:1.0:1789601334.814107:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:5607:x1876532858455808:12345-192.168.201.30@tcp:502: Request processed in 331us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601334.814116:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 123 00000100:00100000:3.0:1789601334.823079:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601334.823260:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858455936 00000100:00100000:2.0:1789601334.823272:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858455936 00000100:00100000:2.0:1789601334.823327:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:2.0:1789601334.823342:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:5607:x1876532858455936:12345-192.168.201.30@tcp:502: 00000100:00100000:2.0:1789601334.823591:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:5607:x1876532858455936:12345-192.168.201.30@tcp:502: Request processed in 254us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601334.823598:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:3.0:1789601334.832555:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601334.832722:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858456064 00000100:00100000:0.0:1789601334.832733:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858456064 00000100:00100000:0.0:1789601334.832778:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:0.0:1789601334.832786:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1876532858456064:12345-192.168.201.30@tcp:38: 00010000:00080000:0.0:1789601334.832815:0:5839:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:0.0:1789601334.832891:0:5839:0:(genops.c:1384:class_connect()) connect: client 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6, cookie 0xf3d6e402158abefb 00000004:00100000:0.0:1789601334.832922:0:5839:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1789601334.832929:0:5839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1789601334.876959:0:5839:0:(import.c:65:import_set_state_nolock()) ffff91edf9db2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601334.877056:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2355:x1876532858456064:12345-192.168.201.30@tcp:38: Request processed in 44267us (44509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601334.877077:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:0.0:1789601335.241175:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc704ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880498048:0@lo:400: 00000100:00100000:1.0:1789601335.241380:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc7049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880497792:0@lo:400: 00000100:00100000:1.0:1789601335.241416:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601335.241466:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc704aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880498304:0@lo:400: 00000100:00100000:1.0:1789601335.241501:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601335.241528:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789601335.241532:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc7049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880497664:0@lo:400: 00000100:00100000:1.0:1789601335.241554:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601335.241568:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc7049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880498176:0@lo:400: 00000100:00100000:1.0:1789601335.241579:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601335.241598:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880497664 00000100:00100000:1.0:1789601335.241604:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880497664 00000100:00100000:1.0:1789601335.241635:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789601335.241641:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880497664:12345-0@lo:400: 00000100:00100000:1.0:1789601335.241677:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880497664:12345-0@lo:400: Request processed in 35us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601335.241683:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789601335.241728:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc7049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880497664:0@lo:400: 00000100:00100000:3.0:1789601335.241893:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880497792 00000100:00100000:3.0:1789601335.241896:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880497792 00000100:00100000:3.0:1789601335.241924:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880498176 00000100:00100000:3.0:1789601335.241926:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880498176 00000100:00100000:3.0:1789601335.241944:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789601335.241948:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880497792:12345-0@lo:400: 00000100:00100000:3.0:1789601335.241979:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880497792:12345-0@lo:400: Request processed in 31us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601335.241983:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789601335.241991:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789601335.241995:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880498176:12345-0@lo:400: 00000100:00100000:3.0:1789601335.242018:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880498176:12345-0@lo:400: Request processed in 23us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601335.242024:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1789601335.242044:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789601335.242066:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edc7049c00 x1876532880498176/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601335.242077:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc7049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880498176:0@lo:400: 00010000:00080000:3.0:1789601335.242087:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edc7049880 x1876532880497792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601335.242095:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc7049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880497792:0@lo:400: 00000100:00100000:0.0:1789601335.242445:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601335.242642:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc704a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880497920:0@lo:400: 00000100:00100000:2.0:1789601335.242675:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601335.242738:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880497920 00000100:00100000:3.0:1789601335.242743:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880497920 00000100:00100000:3.0:1789601335.242772:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789601335.242788:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880497920:12345-0@lo:400: 00000100:00100000:3.0:1789601335.242823:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880497920:12345-0@lo:400: Request processed in 45us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601335.242829:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1789601335.242858:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789601335.242881:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edc704a680 x1876532880497920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601335.242891:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc704a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880497920:0@lo:400: 00000100:00100000:1.0:1789601335.243205:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880498304 00000100:00100000:1.0:1789601335.243218:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880498304 00000100:00100000:1.0:1789601335.243354:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880498048 00000100:00100000:1.0:1789601335.243358:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880498048 00000100:00100000:0.0:1789601335.243402:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789601335.243410:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880498304:12345-0@lo:400: 00000100:00100000:0.0:1789601335.243454:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880498304:12345-0@lo:400: Request processed in 45us (1952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601335.243459:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789601335.243509:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edc704aa00 x1876532880498304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601335.243518:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789601335.243529:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc704aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880498304:0@lo:400: 00000100:00080000:3.0:1789601335.245381:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789601335.245390:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601335.248042:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789601335.248059:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc704a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880498048:12345-0@lo:400: 00000100:00100000:1.0:1789601335.248179:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc704a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880498048:12345-0@lo:400: Request processed in 127us (5733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601335.248187:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789601335.248424:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edc704ad80 x1876532880498048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601335.248439:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc704ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880498048:0@lo:400: 00010000:00010000:1.0:1789601335.305031:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601335.753539:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789601335.753566:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc704aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880498432:0@lo:13: 00000100:00100000:2.0:1789601335.753635:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601335.753879:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880498432 00000100:00100000:1.0:1789601335.753887:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880498432 00000100:00100000:1.0:1789601335.753939:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789601335.753951:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880498432:12345-0@lo:13: 00002000:00000024:1.0:1789601335.753986:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601335.754053:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880498432:12345-0@lo:13: Request processed in 104us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601335.754059:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789601335.754164:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edc704aa00 x1876532880498432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601335.754182:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc704aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880498432:0@lo:13: 00000100:00100000:3.0:1789601335.885113:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601335.885272:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858456320 00000100:00100000:1.0:1789601335.885282:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858456320 00000100:00100000:1.0:1789601335.885362:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:1.0:1789601335.885374:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:5585:x1876532858456320:12345-192.168.201.30@tcp:41: 00000004:00000024:1.0:1789601335.885419:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789601335.885505:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8de8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:5585:x1876532858456320:12345-192.168.201.30@tcp:41: Request processed in 133us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601335.885512:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00080000:3.0:1789601335.886289:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601335.886373:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601335.895221:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858456192 00000100:00100000:3.0:1789601335.895236:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858456192 00000100:00100000:3.0:1789601335.895302:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:3.0:1789601335.895313:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:0:x1876532858456192:12345-192.168.201.30@tcp:41: 00000004:00000024:3.0:1789601335.895382:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789601335.895453:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:0:x1876532858456192:12345-192.168.201.30@tcp:41: Request processed in 142us (9082us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601335.895460:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:2.0:1789601335.895594:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601335.895690:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858456448 00000100:00100000:2.0:1789601335.895695:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858456448 00000100:00100000:2.0:1789601335.895719:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1789601335.895740:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:5585:x1876532858456448:12345-192.168.201.30@tcp:40: 00000100:00100000:2.0:1789601335.895779:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:5585:x1876532858456448:12345-192.168.201.30@tcp:40: Request processed in 41us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601335.895786:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1789601335.902182:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601335.902222:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601335.902294:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601335.902326:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858456832 00000100:00100000:3.0:1789601335.902344:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858456832 00000100:00100000:2.0:1789601335.902400:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601335.902424:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:3.0:1789601335.902439:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:5585:x1876532858456832:12345-192.168.201.30@tcp:33: 00000100:00100000:0.0:1789601335.902455:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858456960 00000100:00100000:0.0:1789601335.902466:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858456960 00000100:00100000:0.0:1789601335.902522:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 126 00000100:00100000:0.0:1789601335.902532:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2357:x1876532858456960:12345-192.168.201.30@tcp:400: 00000100:00100000:0.0:1789601335.902605:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2357:x1876532858456960:12345-192.168.201.30@tcp:400: Request processed in 74us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601335.902612:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 126 00000100:00100000:1.0:1789601335.914690:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858456576 00000100:00100000:1.0:1789601335.914707:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858456576 00000100:00100000:1.0:1789601335.914780:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858456704 00000100:00100000:1.0:1789601335.914784:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858456704 00000100:00100000:1.0:1789601335.914804:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:1.0:1789601335.914814:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1876532858456576:12345-192.168.201.30@tcp:8: 00010000:00080000:1.0:1789601335.914873:0:6677:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:1.0:1789601335.914906:0:6677:0:(genops.c:1384:class_connect()) connect: client 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6, cookie 0xf3d6e402158abf02 00002000:00100000:1.0:1789601335.914918:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6/ffff91edf8ac0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789601335.914940:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789601335.915534:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789601335.915569:0:6677:0:(import.c:65:import_set_state_nolock()) ffff91edf8ac1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789601335.915646:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2355:x1876532858456576:12345-192.168.201.30@tcp:8: Request processed in 831us (13353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601335.915710:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:1.0:1789601335.915740:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:1.0:1789601335.915745:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1876532858456704:12345-192.168.201.30@tcp:8: 00010000:00080000:1.0:1789601335.915762:0:6677:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:1.0:1789601335.915781:0:6677:0:(genops.c:1384:class_connect()) connect: client 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6, cookie 0xf3d6e402158abf09 00002000:00100000:1.0:1789601335.915788:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6/ffff91edf8ac7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789601335.915794:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789601335.916561:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789601335.916585:0:6677:0:(import.c:65:import_set_state_nolock()) ffff91edf8ac2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789601335.916619:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2355:x1876532858456704:12345-192.168.201.30@tcp:8: Request processed in 873us (14220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601335.916627:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000004:00080000:3.0:1789601335.930974:0:5840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 28428us 00000004:00200000:3.0:1789601335.940202:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789601335.940357:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:5585:x1876532858456832:12345-192.168.201.30@tcp:33: Request processed in 37916us (38179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601335.940367:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:2.0:1789601336.132143:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601336.132326:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858457088 00000100:00100000:1.0:1789601336.132351:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858457088 00000100:00100000:1.0:1789601336.132456:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:1.0:1789601336.132467:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:5624:x1876532858457088:12345-192.168.201.30@tcp:101: 00010000:00010000:1.0:1789601336.132490:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601336.132518:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158abf10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5060f5c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601336.132580:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88200/0xf3d6e402158abf17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601336.132595:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88200/0xf3d6e402158abf17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601336.132610:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88200/0xf3d6e402158abf17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601336.132644:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789601336.132649:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789601336.132666:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88200/0xf3d6e402158abf17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601336.132694:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158abf10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f5c expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601336.132724:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88200/0xf3d6e402158abf17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f5c expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601336.132732:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd35e8b00) 00010000:00010000:1.0:1789601336.132735:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789601336.132739:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88200, rc 0) 00000100:00100000:1.0:1789601336.132928:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:5624:x1876532858457088:12345-192.168.201.30@tcp:101: Request processed in 462us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601336.132935:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00010000:00010000:2.0:1789601336.331868:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601337.352977:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601338.313095:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880498560:0@lo:13: 00000100:00100000:0.0:1789601338.313174:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601338.313317:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880498560 00000100:00100000:1.0:1789601338.313326:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880498560 00000100:00100000:1.0:1789601338.313388:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789601338.313396:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc704aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880498560:12345-0@lo:13: 00002000:00000024:1.0:1789601338.313427:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789601338.313562:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601338.313824:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc704aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880498560:12345-0@lo:13: Request processed in 427us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601338.313832:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789601338.313928:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00c6b800 x1876532880498560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601338.313945:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880498560:0@lo:13: 00010000:00010000:2.0:1789601338.382801:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601338.494191:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601338.494297:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858457216 00000100:00100000:3.0:1789601338.494308:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858457216 00000100:00100000:3.0:1789601338.494387:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:3.0:1789601338.494400:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc7049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:5677:x1876532858457216:12345-192.168.201.30@tcp:41: 00000004:00000024:3.0:1789601338.494445:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:0.0:1789601338.494618:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601338.494653:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc7049500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:5677:x1876532858457216:12345-192.168.201.30@tcp:41: Request processed in 256us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601338.494662:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:0.0:1789601338.502391:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601338.502530:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858457344 00000100:00100000:2.0:1789601338.502542:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858457344 00000100:00100000:2.0:1789601338.502619:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:2.0:1789601338.502630:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc7048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:5677:x1876532858457344:12345-192.168.201.30@tcp:13: 00002000:00000024:2.0:1789601338.502657:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601338.502729:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc7048a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:5677:x1876532858457344:12345-192.168.201.30@tcp:13: Request processed in 101us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601338.502736:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00080000:0.0:1789601338.503279:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601338.507645:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601338.507734:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858457472 00000100:00100000:1.0:1789601338.507744:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858457472 00000100:00100000:1.0:1789601338.507816:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:1.0:1789601338.507826:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:5677:x1876532858457472:12345-192.168.201.30@tcp:13: 00000100:00080000:0.0:1789601338.508020:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1789601338.508101:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601338.508171:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:5677:x1876532858457472:12345-192.168.201.30@tcp:13: Request processed in 345us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601338.508188:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00010000:00010000:0.0:1789601339.405201:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789601339.971088:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 00000001:00100000:0.0:1789601339.988708:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 00000100:00100000:2.0:1789601340.361159:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880499072:0@lo:400: 00000100:00100000:3.0:1789601340.361220:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880498688:0@lo:400: 00000100:00100000:2.0:1789601340.361235:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601340.361308:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601340.361315:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789601340.361326:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880498944:0@lo:400: 00000100:00100000:3.0:1789601340.361364:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876532880499200:0@lo:400: 00000100:00100000:3.0:1789601340.361397:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601340.361429:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789601340.361439:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880498816:0@lo:400: 00000100:00100000:2.0:1789601340.361448:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601340.363909:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601340.363989:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880499328:0@lo:400: 00000100:00100000:3.0:1789601340.365319:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601340.365396:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880499072 00000100:00100000:3.0:1789601340.365408:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880499072 00000100:00100000:3.0:1789601340.365488:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880499328 00000100:00100000:3.0:1789601340.365508:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880499328 00000100:00100000:3.0:1789601340.365534:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789601340.365546:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880499072:12345-0@lo:400: 00000100:00100000:3.0:1789601340.365612:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880499072:12345-0@lo:400: Request processed in 69us (4378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601340.365619:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789601340.365641:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789601340.365646:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880499328:12345-0@lo:400: 00000100:00100000:3.0:1789601340.365679:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8dead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880499328:12345-0@lo:400: Request processed in 33us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601340.365685:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789601340.365706:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880498688 00000100:00100000:3.0:1789601340.365711:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880498688 00000100:00100000:3.0:1789601340.365750:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789601340.365757:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3319:x1876532880498688:12345-0@lo:400: 00000100:00100000:3.0:1789601340.365792:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3319:x1876532880498688:12345-0@lo:400: Request processed in 36us (4485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601340.365798:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789601340.365831:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880499200 00000100:00100000:3.0:1789601340.365859:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880499200 00000100:00100000:3.0:1789601340.365884:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880498944 00000100:00100000:3.0:1789601340.365888:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880498944 00000100:00100000:1.0:1789601340.365907:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880498816 00000100:00100000:3.0:1789601340.365918:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789601340.365926:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880498816 00000100:00100000:3.0:1789601340.365928:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876532880499200:12345-0@lo:400: 00000100:00100000:3.0:1789601340.365976:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876532880499200:12345-0@lo:400: Request processed in 48us (4576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601340.365983:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789601340.365998:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789601340.366007:0:5839:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789601340.366011:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880498944:12345-0@lo:400: 00000100:00100000:3.0:1789601340.366047:0:5839:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:3.0:1789601340.366072:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601340.366079:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601340.366081:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601340.366127:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880498944:12345-0@lo:400: Request processed in 120us (4688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601340.366135:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789601340.366177:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789601340.366183:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880498816:12345-0@lo:400: 00000100:00100000:1.0:1789601340.366215:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880498816:12345-0@lo:400: Request processed in 33us (2317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601340.366221:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789601340.366379:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880498944:0@lo:400: 00010000:00080000:2.0:1789601340.366408:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00a3fb80 x1876532880499072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601340.366419:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880499072:0@lo:400: 00000100:00100000:2.0:1789601340.366508:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880498816:0@lo:400: 00010000:00080000:2.0:1789601340.366522:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00a3f480 x1876532880499328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601340.366530:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880499328:0@lo:400: 00000100:00100000:2.0:1789601340.366541:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880498688:0@lo:400: 00000100:00100000:2.0:1789601340.366552:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876532880499200:0@lo:400: 00000001:00100000:3.0:1789601340.416054:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 00010000:00010000:2.0:1789601340.426575:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601340.879727:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789601340.879755:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880499456:0@lo:13: 00000100:00100000:2.0:1789601340.879828:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601340.880025:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880499456 00000100:00100000:1.0:1789601340.880035:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880499456 00000100:00100000:1.0:1789601340.880092:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789601340.880103:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880499456:12345-0@lo:13: 00002000:00000024:1.0:1789601340.880155:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601340.880213:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880499456:12345-0@lo:13: Request processed in 112us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601340.880232:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789601340.884465:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edd8de8000 x1876532880499456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601340.884498:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8de8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880499456:0@lo:13: 00000100:00100000:3.0:1789601341.405664:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601341.405698:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601341.405720:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601341.405745:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601341.405772:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858457600 00000100:00100000:3.0:1789601341.405782:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858457600 00000100:00100000:3.0:1789601341.405826:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 128 00000100:00100000:3.0:1789601341.405854:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2359:x1876532858457600:12345-192.168.201.30@tcp:400: 00000100:00100000:3.0:1789601341.405927:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2359:x1876532858457600:12345-192.168.201.30@tcp:400: Request processed in 92us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601341.405935:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 128 00000100:00100000:0.0:1789601341.408263:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858457728 00000100:00100000:0.0:1789601341.408275:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858457728 00000100:00100000:0.0:1789601341.408362:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:0.0:1789601341.408374:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2359:x1876532858457728:12345-192.168.201.30@tcp:400: 00000100:00100000:0.0:1789601341.408443:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2359:x1876532858457728:12345-192.168.201.30@tcp:400: Request processed in 72us (2720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601341.408450:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00080000:2.0:1789601341.408720:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601341.408786:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858457856 00000100:00100000:3.0:1789601341.408791:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858457856 00000100:00100000:3.0:1789601341.409402:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858457984 00000100:00100000:3.0:1789601341.409408:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858457984 00000100:00100000:1.0:1789601341.409765:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:1.0:1789601341.409777:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2359:x1876532858457856:12345-192.168.201.30@tcp:400: 00000100:00100000:1.0:1789601341.409830:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8dea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2359:x1876532858457856:12345-192.168.201.30@tcp:400: Request processed in 57us (4131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601341.409865:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00080000:2.0:1789601341.410370:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789601341.410375:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601341.410513:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:3.0:1789601341.410523:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2359:x1876532858457984:12345-192.168.201.30@tcp:400: 00000100:00100000:3.0:1789601341.410559:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2359:x1876532858457984:12345-192.168.201.30@tcp:400: Request processed in 38us (4813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601341.410565:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00010000:00010000:0.0:1789601341.449305:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789601341.689879:0:8285:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789601342.473763:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601343.444256:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601343.444282:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880499584:0@lo:13: 00000100:00100000:2.0:1789601343.444351:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601343.444460:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880499584 00000100:00100000:1.0:1789601343.444469:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880499584 00000100:00100000:1.0:1789601343.444540:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789601343.444551:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880499584:12345-0@lo:13: 00002000:00000024:1.0:1789601343.444589:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601343.444633:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880499584:12345-0@lo:13: Request processed in 84us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601343.444639:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789601343.444753:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789601343.444793:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00c6a300 x1876532880499584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601343.444810:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880499584:0@lo:13: 00010000:00010000:3.0:1789601343.498077:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601344.527933:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601345.488229:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc7048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880499712:0@lo:400: 00000100:00100000:2.0:1789601345.488329:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601345.488393:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601345.488400:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc704bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880499840:0@lo:400: 00000100:00100000:2.0:1789601345.488427:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601345.488456:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc704b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880499968:0@lo:400: 00000100:00100000:2.0:1789601345.488479:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601345.488495:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601345.488501:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc704b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880500096:0@lo:400: 00000100:00100000:2.0:1789601345.488524:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601345.489440:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880499712 00000100:00100000:3.0:1789601345.489465:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880499712 00000100:00100000:3.0:1789601345.489516:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789601345.489525:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3319:x1876532880499712:12345-0@lo:400: 00000100:00100000:3.0:1789601345.489593:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3319:x1876532880499712:12345-0@lo:400: Request processed in 69us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601345.489600:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789601345.489637:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880499840 00000100:00100000:3.0:1789601345.489641:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880499840 00000100:00100000:3.0:1789601345.489668:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880499968 00000100:00100000:3.0:1789601345.489670:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880499968 00000100:00100000:3.0:1789601345.489699:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789601345.489706:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880499840:12345-0@lo:400: 00000100:00100000:3.0:1789601345.489737:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880499840:12345-0@lo:400: Request processed in 33us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601345.489743:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789601345.489754:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789601345.489759:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880499968:12345-0@lo:400: 00000100:00100000:3.0:1789601345.489791:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880499968:12345-0@lo:400: Request processed in 31us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601345.489796:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789601345.489817:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880500096 00000100:00100000:3.0:1789601345.489821:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880500096 00000100:00100000:3.0:1789601345.489865:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789601345.489872:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880500096:12345-0@lo:400: 00000100:00100000:3.0:1789601345.489901:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880500096:12345-0@lo:400: Request processed in 31us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601345.489906:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789601345.489987:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789601345.489993:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601345.490374:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc704bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880499840:0@lo:400: 00000100:00100000:3.0:1789601345.490385:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc7048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880499712:0@lo:400: 00010000:00080000:3.0:1789601345.490430:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edc704b480 x1876532880500096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601345.490441:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc704b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880500096:0@lo:400: 00000100:00100000:3.0:1789601345.490451:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc704b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880499968:0@lo:400: 00000100:00100000:3.0:1789601345.491374:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc7049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876532880500224:0@lo:400: 00000100:00100000:3.0:1789601345.491422:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601345.491456:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601345.491462:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc7048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880500352:0@lo:400: 00000100:00100000:3.0:1789601345.491488:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601345.491522:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880500352 00000100:00100000:3.0:1789601345.491528:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880500352 00000100:00100000:3.0:1789601345.491566:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789601345.491574:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880500352:12345-0@lo:400: 00000100:00100000:3.0:1789601345.491616:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880500352:12345-0@lo:400: Request processed in 43us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601345.491624:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789601345.491641:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789601345.491665:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edc7048700 x1876532880500352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601345.491676:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc7048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880500352:0@lo:400: 00000100:00100000:0.0:1789601345.491728:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880500224 00000100:00100000:0.0:1789601345.491733:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880500224 00000100:00100000:0.0:1789601345.491788:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789601345.491794:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876532880500224:12345-0@lo:400: 00000100:00100000:0.0:1789601345.491830:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876532880500224:12345-0@lo:400: Request processed in 36us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601345.491860:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1789601345.493308:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601345.493367:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc7049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876532880500224:0@lo:400: 00010000:00010000:0.0:1789601345.547246:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601346.000878:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601346.000913:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880500480:0@lo:13: 00000100:00100000:3.0:1789601346.000994:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601346.003218:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880500480 00000100:00100000:1.0:1789601346.003234:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880500480 00000100:00100000:1.0:1789601346.003298:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789601346.003308:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880500480:12345-0@lo:13: 00002000:00000024:1.0:1789601346.003348:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601346.003427:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880500480:12345-0@lo:13: Request processed in 122us (2432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601346.003433:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789601346.008034:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf7edc700 x1876532880500480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601346.008077:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880500480:0@lo:13: 00000020:00000080:3.0:1789601346.314134:0:8432:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3dd01db0 20000000:00000080:3.0:1789601346.314152:0:8432:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91ee00b2a000 uarg=0000000000000000 20000000:01000000:3.0:1789601346.314187:0:8432:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789601346.314190:0:8432:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789601346.314193:0:8432:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789601346.314198:0:8432:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789601346.314202:0:8432:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789601346.314217:0:8432:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789601346.314219:0:8432:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789601346.314406:0:8432:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789601346.314409:0:8432:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789601346.315258:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1789601346.317265:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1789601346.317323:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1789601346.317355:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1789601346.317366:0:8432:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789601346.317369:0:8432:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789601346.318733:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1789601346.320358:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1789601346.320425:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1789601346.320457:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1789601346.320470:0:8432:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789601346.320472:0:8432:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789601346.321467:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789601346.322147:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789601346.322211:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1789601346.322248:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1789601346.322261:0:8432:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789601346.322263:0:8432:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789601346.324478:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1789601346.325422:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1789601346.325474:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1789601346.325525:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:2.0:1789601346.325545:0:8432:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789601346.325565:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf1e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.325583:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abe1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abe14 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.325601:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc0031e00/0xf3d6e402158abe45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abe3e expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.325608:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ee02044a00/0xf3d6e402158abe6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abe68 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.325614:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc0030c00/0xf3d6e402158abe7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abe76 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.325621:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ee02044600/0xf3d6e402158abe8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abe84 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.325627:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc29c5400/0xf3d6e402158abea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abea0 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.325635:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ee02045400/0xf3d6e402158abed1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abeca expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.325644:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc29c5600/0xf3d6e402158abedf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060efa expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.325650:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc0030e00/0xf3d6e402158abee6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f01 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.325657:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf1e lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.325693:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc0030e00/0xf3d6e402158abee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f01 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.325718:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91edc0030e00/0xf3d6e402158abee6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f01 expref: 9 pid: 5830 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601346.325732:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1876532880500608:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789601346.326089:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc29c5600/0xf3d6e402158abedf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060efa expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.326099:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91edc29c5600/0xf3d6e402158abedf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060efa expref: 9 pid: 5830 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601346.326107:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1876532880500736:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789601346.326138:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ee02045400/0xf3d6e402158abed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abeca expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.326146:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ee02045400/0xf3d6e402158abed1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abeca expref: 18 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601346.326155:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1876532880500864:0@lo:104: 00000100:00100000:2.0:1789601346.326196:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789601346.326244:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc29c5400/0xf3d6e402158abea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abea0 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.326252:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edc29c5400/0xf3d6e402158abea7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abea0 expref: 18 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601346.326261:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1876532880500992:0@lo:104: 00000100:00100000:2.0:1789601346.326290:0:8432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789601346.326334:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ee02044600/0xf3d6e402158abe8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abe84 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.326342:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ee02044600/0xf3d6e402158abe8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abe84 expref: 18 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601346.326349:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1876532880501120:0@lo:104: 00010000:00010000:2.0:1789601346.326369:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc0030c00/0xf3d6e402158abe7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abe76 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.326376:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edc0030c00/0xf3d6e402158abe7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abe76 expref: 18 pid: 5830 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601346.326383:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1876532880501248:0@lo:104: 00010000:00010000:2.0:1789601346.326421:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ee02044a00/0xf3d6e402158abe6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abe68 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.326429:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ee02044a00/0xf3d6e402158abe6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abe68 expref: 18 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601346.326437:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1876532880501376:0@lo:104: 00010000:00010000:2.0:1789601346.326462:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc0031e00/0xf3d6e402158abe45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abe3e expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.326469:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edc0031e00/0xf3d6e402158abe45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abe3e expref: 18 pid: 5830 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601346.326476:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1876532880501504:0@lo:104: 00010000:00010000:2.0:1789601346.326494:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abe1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abe14 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.326510:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abe1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abe14 expref: 18 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601346.326518:0:8432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1876532880501632:0@lo:104: 00000100:00100000:2.0:1789601346.326538:0:8432:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604000 going to sleep for 11 seconds 00000100:00100000:1.0:1789601346.326613:0:7625:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789601346.326629:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601346.326647:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601346.326653:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601346.326660:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601346.326673:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601346.326682:0:7625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880500864 00000100:00100000:1.0:1789601346.326687:0:7625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880500864 00000100:00100000:1.0:1789601346.326714:0:7625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880500992 00000100:00100000:1.0:1789601346.326715:0:7625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880500992 00000100:00100000:1.0:1789601346.326721:0:7625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880501120 00000100:00100000:1.0:1789601346.326722:0:7625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880501120 00000100:00100000:1.0:1789601346.326727:0:7625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880501248 00000100:00100000:1.0:1789601346.326728:0:7625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880501248 00000100:00100000:1.0:1789601346.326733:0:7625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880501376 00000100:00100000:1.0:1789601346.326734:0:7625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880501376 00000100:00100000:1.0:1789601346.326738:0:7625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880501504 00000100:00100000:1.0:1789601346.326740:0:7625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880501504 00000100:00100000:1.0:1789601346.326743:0:7625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880501632 00000100:00100000:1.0:1789601346.326744:0:7625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880501632 00000100:00100000:1.0:1789601346.326758:0:7625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789601346.326766:0:7625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+9:8432:x1876532880500864:12345-0@lo:104: 00010000:00010000:1.0:1789601346.326779:0:7625:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abeca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abed1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.326833:0:7625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789601346.326866:0:7625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+9:8432:x1876532880500864:12345-0@lo:104: Request processed in 101us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601346.326873:0:7625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789601346.326893:0:7625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789601346.326899:0:7625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0028b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+8:8432:x1876532880500992:12345-0@lo:104: 00010000:00010000:1.0:1789601346.326906:0:7625:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc3b88e00/0xf3d6e402158abea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abea7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.326951:0:7625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789601346.326956:0:7625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0028b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+8:8432:x1876532880500992:12345-0@lo:104: Request processed in 58us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601346.326962:0:7625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789601346.326991:0:7625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789601346.326996:0:7625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+7:8432:x1876532880501120:12345-0@lo:104: 00010000:00010000:1.0:1789601346.327001:0:7625:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abe84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abe8b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.327019:0:7625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789601346.327022:0:7625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+7:8432:x1876532880501120:12345-0@lo:104: Request processed in 27us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601346.327026:0:7625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789601346.327032:0:7625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789601346.327035:0:7625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+6:8432:x1876532880501248:12345-0@lo:104: 00010000:00010000:1.0:1789601346.327039:0:7625:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc29c5a00/0xf3d6e402158abe76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abe7d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.327059:0:7625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789601346.327062:0:7625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+6:8432:x1876532880501248:12345-0@lo:104: Request processed in 27us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601346.327066:0:7625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789601346.327073:0:7625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789601346.327076:0:7625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+5:8432:x1876532880501376:12345-0@lo:104: 00010000:00010000:1.0:1789601346.327081:0:7625:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abe6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.327093:0:7625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789601346.327096:0:7625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+5:8432:x1876532880501376:12345-0@lo:104: Request processed in 20us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601346.327099:0:7625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789601346.327104:0:7625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789601346.327107:0:7625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+4:8432:x1876532880501504:12345-0@lo:104: 00010000:00010000:1.0:1789601346.327111:0:7625:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abe3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abe45 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.327123:0:7625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1789601346.327125:0:7625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+4:8432:x1876532880501504:12345-0@lo:104: Request processed in 18us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601346.327128:0:7625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789601346.327133:0:7625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789601346.327136:0:7625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8310000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:8432:x1876532880501632:12345-0@lo:104: 00010000:00010000:1.0:1789601346.327140:0:7625:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abe14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abe1b expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.327159:0:7625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1789601346.327162:0:7625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8310000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:8432:x1876532880501632:12345-0@lo:104: Request processed in 26us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601346.327166:0:7625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789601346.329767:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1876532880500864:0@lo:104: 00000100:00100000:2.0:1789601346.329784:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1876532880500992:0@lo:104: 00000100:00100000:2.0:1789601346.329793:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1876532880501120:0@lo:104: 00000100:00100000:2.0:1789601346.329802:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1876532880501248:0@lo:104: 00000100:00100000:2.0:1789601346.329810:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1876532880501376:0@lo:104: 00000100:00100000:2.0:1789601346.329819:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1876532880501504:0@lo:104: 00000100:00100000:2.0:1789601346.329828:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1876532880501632:0@lo:104: 00010000:00010000:1.0:1789601346.329945:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1789601346.329954:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abeca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abed1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.329964:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee02045000 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601346.329968:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abeca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abed1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.329978:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abeca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abed1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601346.329985:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abeca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abed1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601346.329991:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601346.330051:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abeca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abed1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330058:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601346.330083:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abeca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abed1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330091:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91ee02045000/0xf3d6e402158abeca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abed1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330125:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789601346.330128:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc3b88e00/0xf3d6e402158abea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abea7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330134:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88e00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601346.330137:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b88e00/0xf3d6e402158abea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abea7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330145:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc3b88e00/0xf3d6e402158abea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abea7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601346.330153:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b88e00/0xf3d6e402158abea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abea7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601346.330158:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601346.330173:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc3b88e00/0xf3d6e402158abea0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abea7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330179:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601346.330192:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc3b88e00/0xf3d6e402158abea0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abea7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330198:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc3b88e00/0xf3d6e402158abea0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abea7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330205:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789601346.330208:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abe84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abe8b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330224:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89800 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601346.330227:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abe84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abe8b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330233:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abe84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abe8b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601346.330239:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abe84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abe8b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601346.330243:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601346.330256:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abe84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abe8b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330261:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601346.330267:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abe84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abe8b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330274:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158abe84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abe8b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330281:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789601346.330284:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc29c5a00/0xf3d6e402158abe76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abe7d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330290:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5a00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601346.330292:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c5a00/0xf3d6e402158abe76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abe7d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330309:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc29c5a00/0xf3d6e402158abe76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abe7d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601346.330316:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c5a00/0xf3d6e402158abe76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abe7d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601346.330321:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601346.330333:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc29c5a00/0xf3d6e402158abe76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abe7d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330338:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601346.330343:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc29c5a00/0xf3d6e402158abe76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abe7d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330349:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc29c5a00/0xf3d6e402158abe76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abe7d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330358:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789601346.330361:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abe6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330367:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4400 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601346.330370:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abe6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330376:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abe6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601346.330383:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abe6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601346.330397:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601346.330409:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abe6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330414:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601346.330418:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abe6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330425:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abe68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abe6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330433:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789601346.330436:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abe3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abe45 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330441:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0031c00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601346.330444:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abe3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abe45 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330450:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abe3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abe45 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601346.330456:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abe3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abe45 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601346.330461:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601346.330471:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abe3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abe45 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330477:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601346.330487:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abe3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abe45 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330493:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abe3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abe45 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330502:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601346.330505:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abe14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abe1b expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330510:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee02045c00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601346.330513:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abe14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abe1b expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330519:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abe14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abe1b expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601346.330525:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abe14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abe1b expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601346.330531:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601346.330540:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abe14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abe1b expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330546:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601346.330549:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abe14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abe1b expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330555:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91ee02045c00/0xf3d6e402158abe14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abe1b expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.330567:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601346.330573:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601346.330575:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601346.330591:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8311880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880502144:0@lo:103: 00000100:00100000:1.0:1789601346.330652:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601346.330700:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789601346.330705:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880501760:0@lo:103: 00000100:00100000:1.0:1789601346.330722:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601346.330736:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880502272:0@lo:103: 00000100:00100000:1.0:1789601346.330751:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601346.330772:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8311f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880502016:0@lo:103: 00000100:00100000:1.0:1789601346.330791:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601346.330800:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8311c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880502528:0@lo:103: 00000100:00100000:1.0:1789601346.330816:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601346.330824:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789601346.330828:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8313100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880501888:0@lo:103: 00000100:00100000:1.0:1789601346.330879:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601346.330888:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880502400:0@lo:103: 00000100:00100000:1.0:1789601346.330904:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601346.331092:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880502144 00000100:00100000:1.0:1789601346.331100:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880502144 00010000:00010000:1.0:1789601346.331132:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc0030c00/0xf3d6e402158abe7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abe76 expref: 19 pid: 5830 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601346.331152:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880501760 00000100:00100000:1.0:1789601346.331155:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880501760 00010000:00010000:1.0:1789601346.331165:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ee02045400/0xf3d6e402158abed1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abeca expref: 20 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601346.331189:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880502272 00000100:00100000:1.0:1789601346.331193:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880502272 00010000:00010000:1.0:1789601346.331205:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ee02044a00/0xf3d6e402158abe6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abe68 expref: 21 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601346.331215:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880502016 00000100:00100000:1.0:1789601346.331217:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880502016 00010000:00010000:1.0:1789601346.331226:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ee02044600/0xf3d6e402158abe8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abe84 expref: 22 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601346.331236:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880502528 00000100:00100000:1.0:1789601346.331238:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880502528 00010000:00010000:1.0:1789601346.331248:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abe1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abe14 expref: 23 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601346.331257:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880501888 00000100:00100000:1.0:1789601346.331259:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880501888 00010000:00010000:1.0:1789601346.331268:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc29c5400/0xf3d6e402158abea7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abea0 expref: 24 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601346.331277:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880502400 00000100:00100000:1.0:1789601346.331279:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880502400 00010000:00010000:1.0:1789601346.331287:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc0031e00/0xf3d6e402158abe45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abe3e expref: 25 pid: 5830 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601346.331298:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789601346.331305:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8312a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+25:3317:x1876532880502144:12345-0@lo:103: 00010000:00010000:1.0:1789601346.331318:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601346.331323:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc0030c00/0xf3d6e402158abe7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abe76 expref: 25 pid: 5830 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.331344:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc0030c00/0xf3d6e402158abe7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abe76 expref: 25 pid: 5830 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.331357:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc0030c00/0xf3d6e402158abe7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abe76 expref: 25 pid: 5830 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601346.331429:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601346.332193:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601346.332295:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8312a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+24:3317:x1876532880502144:12345-0@lo:103: Request processed in 987us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601346.332304:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789601346.332327:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789601346.332335:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8312300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+23:3317:x1876532880501760:12345-0@lo:103: 00010000:00010000:1.0:1789601346.332349:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601346.332356:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ee02045400/0xf3d6e402158abed1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abeca expref: 23 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.332365:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ee02045400/0xf3d6e402158abed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abeca expref: 23 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.332379:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ee02045400/0xf3d6e402158abed1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abeca expref: 23 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.332388:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601346.332412:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8312300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+22:3317:x1876532880501760:12345-0@lo:103: Request processed in 79us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601346.332418:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789601346.332431:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789601346.332437:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8311500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+21:3317:x1876532880502272:12345-0@lo:103: 00010000:00010000:1.0:1789601346.332452:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601346.332458:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ee02044a00/0xf3d6e402158abe6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abe68 expref: 21 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.332466:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ee02044a00/0xf3d6e402158abe6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abe68 expref: 21 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.332476:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ee02044a00/0xf3d6e402158abe6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abe68 expref: 21 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.332486:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601346.332512:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8311500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+20:3317:x1876532880502272:12345-0@lo:103: Request processed in 75us (1760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601346.332518:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789601346.332531:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789601346.332537:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8310a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880502016:12345-0@lo:103: 00010000:00010000:1.0:1789601346.332545:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601346.332550:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ee02044600/0xf3d6e402158abe8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abe84 expref: 19 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.332558:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ee02044600/0xf3d6e402158abe8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abe84 expref: 19 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.332568:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ee02044600/0xf3d6e402158abe8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abe84 expref: 19 pid: 5832 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.332577:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601346.332613:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8310a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:3320:x1876532880502016:12345-0@lo:103: Request processed in 76us (1820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601346.332628:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789601346.332643:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789601346.332649:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8310e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:3320:x1876532880502528:12345-0@lo:103: 00010000:00010000:1.0:1789601346.332659:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601346.332663:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abe1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abe14 expref: 17 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.332672:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abe1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abe14 expref: 17 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.332682:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abe1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abe14 expref: 17 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.332691:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601346.332714:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8310e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:3320:x1876532880502528:12345-0@lo:103: Request processed in 66us (1897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601346.332720:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789601346.332733:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789601346.332739:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8313b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:3320:x1876532880501888:12345-0@lo:103: 00010000:00010000:1.0:1789601346.332746:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601346.332763:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc29c5400/0xf3d6e402158abea7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abea0 expref: 15 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.332772:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc29c5400/0xf3d6e402158abea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abea0 expref: 15 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.332780:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc29c5400/0xf3d6e402158abea7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abea0 expref: 15 pid: 5831 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.332803:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601346.332830:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8313b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:3320:x1876532880501888:12345-0@lo:103: Request processed in 91us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601346.333034:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8313100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880501888:0@lo:103: 00000100:00100000:2.0:1789601346.333046:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8311f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880502016:0@lo:103: 00000100:00100000:2.0:1789601346.333053:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8311c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880502528:0@lo:103: 00000100:00100000:1.0:1789601346.333157:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789601346.333171:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789601346.333178:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2225450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:3320:x1876532880502400:12345-0@lo:103: 00010000:00010000:1.0:1789601346.333186:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601346.333191:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc0031e00/0xf3d6e402158abe45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abe3e expref: 13 pid: 5830 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.333200:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc0031e00/0xf3d6e402158abe45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abe3e expref: 13 pid: 5830 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.333210:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc0031e00/0xf3d6e402158abe45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abe3e expref: 13 pid: 5830 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.333221:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601346.333293:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2225450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:3320:x1876532880502400:12345-0@lo:103: Request processed in 115us (2386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601346.333299:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789601346.333628:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880502400:0@lo:103: 00000100:00100000:0.0:1789601346.333733:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8311880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880502144:0@lo:103: 00000100:00100000:0.0:1789601346.333747:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880501760:0@lo:103: 00000100:00100000:0.0:1789601346.333803:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880502272:0@lo:103: 00000100:00100000:3.0:1789601346.342142:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601346.342170:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601346.342253:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858458112 00000100:00100000:1.0:1789601346.342262:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858458112 00000100:00100000:2.0:1789601346.342280:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1876532880500608:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601346.342297:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc0030e00/0xf3d6e402158abee6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f01 expref: 10 pid: 5830 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601346.342329:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858458240 00000100:00100000:1.0:1789601346.342332:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858458240 00010000:00010000:1.0:1789601346.342345:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc29c5600/0xf3d6e402158abedf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060efa expref: 11 pid: 5830 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601346.342356:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:0.0:1789601346.342369:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+11:2357:x1876532858458112:12345-192.168.201.30@tcp:103: 00000100:00100000:1.0:1789601346.342371:0:5822:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789601346.342378:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1789601346.342383:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601346.342389:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc0030e00/0xf3d6e402158abee6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f01 expref: 11 pid: 5830 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601346.342401:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc0030e00/0xf3d6e402158abee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f01 expref: 11 pid: 5830 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601346.342403:0:5824:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789601346.342411:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:1.0:1789601346.342416:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+11:2357:x1876532858458240:12345-192.168.201.30@tcp:103: 00010000:00010000:0.0:1789601346.342419:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc0030e00/0xf3d6e402158abee6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f01 expref: 11 pid: 5830 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.342423:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601346.342427:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc29c5600/0xf3d6e402158abedf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060efa expref: 11 pid: 5830 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.342436:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc29c5600/0xf3d6e402158abedf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060efa expref: 11 pid: 5830 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601346.342445:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789601346.342449:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf1e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.342458:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf1e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.342471:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.342478:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.342484:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf1e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.342491:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.342507:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4800 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601346.342511:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.342518:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf1e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.342528:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf1e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601346.342537:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601346.342586:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2357:x1876532858458240:12345-192.168.201.30@tcp:103: Request processed in 169us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601346.342594:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00010000:00010000:2.0:1789601346.346107:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc29c5600/0xf3d6e402158abedf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060efa expref: 9 pid: 5830 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601346.346125:0:8432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1876532880500736:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789601346.346362:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.346382:0:8432:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.346389:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601346.346395:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf1e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601346.347081:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+8:2357:x1876532858458112:12345-192.168.201.30@tcp:103: Request processed in 4711us (4942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601346.347093:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:2.0:1789601346.526091:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601346.526133:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601346.526160:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601346.526184:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601346.526341:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858458496 00000100:00100000:3.0:1789601346.526355:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858458496 00000100:00100000:3.0:1789601346.526432:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:3.0:1789601346.526444:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858458496:12345-192.168.201.30@tcp:400: 00000100:00100000:3.0:1789601346.526525:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858458496:12345-192.168.201.30@tcp:400: Request processed in 83us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601346.526543:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:3.0:1789601346.526567:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858458752 00000100:00100000:3.0:1789601346.526571:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858458752 00000100:00100000:3.0:1789601346.526595:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858458624 00000100:00100000:3.0:1789601346.526598:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858458624 00000100:00100000:3.0:1789601346.526612:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:3.0:1789601346.526619:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2356:x1876532858458752:12345-192.168.201.30@tcp:400: 00000100:00100000:3.0:1789601346.526646:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2356:x1876532858458752:12345-192.168.201.30@tcp:400: Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601346.526652:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:3.0:1789601346.526663:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:3.0:1789601346.526670:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2356:x1876532858458624:12345-192.168.201.30@tcp:400: 00000100:00100000:3.0:1789601346.526689:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2356:x1876532858458624:12345-192.168.201.30@tcp:400: Request processed in 20us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601346.526695:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:3.0:1789601346.526709:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858458368 00000100:00100000:3.0:1789601346.526712:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858458368 00000100:00100000:3.0:1789601346.526734:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 130 00000100:00100000:3.0:1789601346.526740:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+8:2356:x1876532858458368:12345-192.168.201.30@tcp:400: 00000100:00100000:3.0:1789601346.526763:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+8:2356:x1876532858458368:12345-192.168.201.30@tcp:400: Request processed in 23us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601346.526768:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 130 00000100:00080000:2.0:1789601346.527994:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789601346.528002:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789601346.528005:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789601346.571409:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601347.594259:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789601348.169339:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789601348.169360:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91edc7b4a800 from 39 10000000:01000000:2.0:1789601348.169366:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789601348.169433:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5600/0xf3d6e402158abf25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601348.169446:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc29c5600/0xf3d6e402158abf25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601348.169458:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc29c5600/0xf3d6e402158abf25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601348.169484:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880502656:0@lo:101: 00000100:00100000:2.0:1789601348.169736:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601348.169892:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604000 going to sleep for 11 seconds 00000100:00100000:3.0:1789601348.178635:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880502656 00000100:00100000:3.0:1789601348.178653:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880502656 00000100:00100000:3.0:1789601348.178868:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789601348.178893:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+12:5834:x1876532880502656:12345-0@lo:101: 00010000:00010000:3.0:1789601348.178915:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601348.178936:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edffadcc00/0xf3d6e402158abf2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abf25 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.178966:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edffadcc00/0xf3d6e402158abf2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abf25 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.178978:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edffadcc00/0xf3d6e402158abf2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abf25 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.178987:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadcc00, rc 0) 00000100:00100000:3.0:1789601348.179098:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:5834:x1876532880502656:12345-0@lo:101: Request processed in 219us (9362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601348.179104:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789601348.179215:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880502656:0@lo:101: 00010000:00010000:2.0:1789601348.179235:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc29c5600/0xf3d6e402158abf25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601348.179245:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc29c5600/0xf3d6e402158abf25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abf2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601348.179315:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880502784:0@lo:501: 00000100:00100000:2.0:1789601348.179360:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601348.190985:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604000 going to sleep for 11 seconds 00000100:00100000:0.0:1789601348.194996:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880502784 00000100:00100000:0.0:1789601348.195026:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880502784 00000100:00100000:0.0:1789601348.195104:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789601348.195113:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:5834:x1876532880502784:12345-0@lo:501: 00000100:00100000:0.0:1789601348.197140:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:5834:x1876532880502784:12345-0@lo:501: Request processed in 2021us (17783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601348.197153:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789601348.197360:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880502784:0@lo:501: 00000100:00100000:2.0:1789601348.197422:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880502912:0@lo:503: 00000100:00100000:2.0:1789601348.197482:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601348.197522:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604000 going to sleep for 11 seconds 00000100:00100000:3.0:1789601348.197775:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880502912 00000100:00100000:3.0:1789601348.197784:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880502912 00000100:00100000:3.0:1789601348.197826:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789601348.197859:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:5834:x1876532880502912:12345-0@lo:503: 00000100:00100000:3.0:1789601348.198064:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:5834:x1876532880502912:12345-0@lo:503: Request processed in 207us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601348.198072:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789601348.199645:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880502912:0@lo:503: 00000100:00100000:2.0:1789601348.200994:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8450:1876532880503040:0@lo:502: 00000100:00100000:2.0:1789601348.201212:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601348.201318:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601348.202739:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880503040 00000100:00100000:1.0:1789601348.202754:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880503040 00000100:00100000:3.0:1789601348.203823:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789601348.203917:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:8450:x1876532880503040:12345-0@lo:502: 00000100:00100000:3.0:1789601348.210953:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:8450:x1876532880503040:12345-0@lo:502: Request processed in 7034us (9728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601348.210973:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789601348.211525:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8450:1876532880503040:0@lo:502: 00000100:00100000:2.0:1789601348.211625:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8450:1876532880503168:0@lo:502: 00000100:00100000:2.0:1789601348.211679:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601348.211719:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601348.211870:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880503168 00000100:00100000:3.0:1789601348.211886:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880503168 00000100:00100000:3.0:1789601348.211932:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789601348.211942:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:8450:x1876532880503168:12345-0@lo:502: 00000100:00100000:3.0:1789601348.212219:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:8450:x1876532880503168:12345-0@lo:502: Request processed in 278us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601348.212226:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789601348.212663:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8450:1876532880503168:0@lo:502: 00000040:00080000:2.0:1789601348.212699:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789601348.212942:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789601348.212967:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789601348.212980:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5600/0xf3d6e402158abf25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.212993:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc29c5600/0xf3d6e402158abf25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601348.213016:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789601348.213019:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1789601348.213023:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789601348.213057:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadd800/0xf3d6e402158abf33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.213065:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edffadd800/0xf3d6e402158abf33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.213075:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edffadd800/0xf3d6e402158abf33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601348.213091:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7eddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880503296:0@lo:101: 00000100:00100000:3.0:1789601348.213133:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601348.213173:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7ed46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601348.213585:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880503296 00000100:00100000:1.0:1789601348.213592:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880503296 00000100:00100000:1.0:1789601348.213635:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789601348.213643:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+13:5834:x1876532880503296:12345-0@lo:101: 00010000:00010000:1.0:1789601348.213654:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601348.213668:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abf3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abf33 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601348.213700:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abf3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abf33 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601348.213709:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abf3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abf33 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601348.213717:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88400, rc 0) 00000100:00100000:1.0:1789601348.213764:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:5834:x1876532880503296:12345-0@lo:101: Request processed in 123us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601348.213771:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789601348.213945:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7eddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880503296:0@lo:101: 00010000:00010000:2.0:1789601348.213961:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edffadd800/0xf3d6e402158abf33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf3a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601348.213970:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edffadd800/0xf3d6e402158abf33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abf3a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601348.214036:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880503424:0@lo:501: 00000100:00100000:2.0:1789601348.214063:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601348.214092:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601348.214243:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880503424 00000100:00100000:3.0:1789601348.214248:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880503424 00000100:00100000:3.0:1789601348.214282:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789601348.214290:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:5834:x1876532880503424:12345-0@lo:501: 00000100:00100000:3.0:1789601348.214699:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:5834:x1876532880503424:12345-0@lo:501: Request processed in 409us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601348.214707:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789601348.215556:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880503424:0@lo:501: 00000100:00100000:2.0:1789601348.215603:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880503552:0@lo:503: 00000100:00100000:2.0:1789601348.215659:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601348.215694:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601348.215864:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880503552 00000100:00100000:3.0:1789601348.215870:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880503552 00000100:00100000:3.0:1789601348.215918:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789601348.215926:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:5834:x1876532880503552:12345-0@lo:503: 00000100:00100000:3.0:1789601348.216122:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:5834:x1876532880503552:12345-0@lo:503: Request processed in 196us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601348.216130:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789601348.216662:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880503552:0@lo:503: 00000100:00100000:2.0:1789601348.217529:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8451:1876532880503680:0@lo:502: 00000100:00100000:2.0:1789601348.217675:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601348.217774:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601348.218102:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880503680 00000100:00100000:1.0:1789601348.218110:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880503680 00000100:00100000:1.0:1789601348.218194:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789601348.218206:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:8451:x1876532880503680:12345-0@lo:502: 00000100:00100000:1.0:1789601348.218747:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:8451:x1876532880503680:12345-0@lo:502: Request processed in 541us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601348.218755:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789601348.218889:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8451:1876532880503680:0@lo:502: 00000020:01000000:2.0:1789601348.218925:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601348.218935:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601348.218938:0:8451:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789601348.218944:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789601348.218977:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8451:1876532880503808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601348.219040:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601348.219833:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601348.219993:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880503808 00000100:00100000:3.0:1789601348.220064:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880503808 00000100:00100000:3.0:1789601348.220110:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789601348.220118:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:8451:x1876532880503808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601348.220781:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:8451:x1876532880503808:12345-0@lo:502:llog_process_th.0 Request processed in 662us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601348.220792:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789601348.220974:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8451:1876532880503808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789601348.221090:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601348.221098:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601348.221100:0:8451:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789601348.221106:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1789601348.223723:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1789601348.223758:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789601348.223771:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadd800/0xf3d6e402158abf33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf3a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.223784:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edffadd800/0xf3d6e402158abf33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf3a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601348.223812:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789601348.223816:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91edc825a800 from 39 10000000:01000000:3.0:1789601348.223819:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789601348.223897:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadda00/0xf3d6e402158abf41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.223906:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edffadda00/0xf3d6e402158abf41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.223917:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edffadda00/0xf3d6e402158abf41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601348.223944:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7edd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880503936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789601348.224481:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601348.224532:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7ed4600 going to sleep for 11 seconds 00000100:00100000:2.0:1789601348.224692:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880503936 00000100:00100000:2.0:1789601348.224701:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880503936 00000100:00100000:2.0:1789601348.224743:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789601348.224752:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:5834:x1876532880503936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601348.224765:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601348.224779:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abf41 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601348.224805:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abf41 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601348.224817:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abf41 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601348.224827:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c4800, rc 0) 00000100:00100000:2.0:1789601348.226725:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:5834:x1876532880503936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1966us (2237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601348.226738:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789601348.227174:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7edd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880503936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601348.227198:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edffadda00/0xf3d6e402158abf41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf48 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.227210:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edffadda00/0xf3d6e402158abf41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abf48 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601348.227697:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc7048000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880504064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601348.227752:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601348.228092:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc53866c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601348.228728:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880504064 00000100:00100000:1.0:1789601348.228738:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880504064 00000100:00100000:1.0:1789601348.228828:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789601348.228875:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:5834:x1876532880504064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601348.229485:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:5834:x1876532880504064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 647us (1730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601348.229494:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789601348.229890:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc7048000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880504064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601348.229958:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc7048000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880504192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601348.230027:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601348.230110:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc53866c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601348.230290:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880504192 00000100:00100000:2.0:1789601348.230297:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880504192 00000100:00100000:3.0:1789601348.230780:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789601348.230789:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:5834:x1876532880504192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601348.231159:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:5834:x1876532880504192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 370us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601348.231167:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789601348.231503:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc7048000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880504192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601348.232486:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7edd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8452:1876532880504320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601348.232621:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601348.232707:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7ed4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789601348.232751:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880504320 00000100:00100000:0.0:1789601348.232760:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880504320 00000100:00100000:0.0:1789601348.232951:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789601348.232961:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:8452:x1876532880504320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601348.233626:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:8452:x1876532880504320:12345-0@lo:502:llog_process_th.0 Request processed in 665us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601348.233636:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789601348.233991:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7edd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8452:1876532880504320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601348.234127:0:8452:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7edd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8452:1876532880504448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601348.234170:0:8452:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601348.234334:0:8452:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7ed4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789601348.234514:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880504448 00000100:00100000:0.0:1789601348.234528:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880504448 00000100:00100000:0.0:1789601348.234584:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789601348.234592:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:8452:x1876532880504448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601348.234780:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:8452:x1876532880504448:12345-0@lo:502:llog_process_th.0 Request processed in 189us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601348.234787:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789601348.234947:0:8452:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7edd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8452:1876532880504448:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789601348.234970:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789601348.235205:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789601348.235228:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789601348.235237:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadda00/0xf3d6e402158abf41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf48 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601348.235355:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edffadda00/0xf3d6e402158abf41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf48 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601348.235365:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789601348.235368:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789601348.235371:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789601348.235522:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abf4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601348.235532:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abf4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601348.235543:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abf4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601348.235627:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc7048000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880504576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789601348.235665:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601348.235701:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03da540 going to sleep for 11 seconds 00000100:00100000:3.0:1789601348.235766:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880504576 00000100:00100000:3.0:1789601348.235771:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880504576 00000100:00100000:3.0:1789601348.235808:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789601348.235816:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+15:5834:x1876532880504576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601348.235826:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601348.235861:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edffadd000/0xf3d6e402158abf56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abf4f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.235896:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edffadd000/0xf3d6e402158abf56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abf4f expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.235908:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edffadd000/0xf3d6e402158abf56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abf4f expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.235917:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadd000, rc 0) 00000100:00100000:3.0:1789601348.235953:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:5834:x1876532880504576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601348.235959:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789601348.236173:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc7048000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880504576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789601348.236187:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abf4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601348.236196:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abf4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abf56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601348.236533:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc7048000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880504704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601348.236645:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601348.236678:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03da540 going to sleep for 11 seconds 00000100:00100000:3.0:1789601348.236734:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880504704 00000100:00100000:3.0:1789601348.236739:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880504704 00000100:00100000:3.0:1789601348.236768:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789601348.236774:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:5834:x1876532880504704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601348.237091:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:5834:x1876532880504704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 315us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601348.237098:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789601348.237314:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc7048000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880504704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601348.237370:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8312a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880504832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601348.237538:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601348.237632:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc7343600 going to sleep for 11 seconds 00000100:00100000:3.0:1789601348.237682:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880504832 00000100:00100000:3.0:1789601348.237687:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880504832 00000100:00100000:3.0:1789601348.237719:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789601348.237726:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:5834:x1876532880504832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601348.238251:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:5834:x1876532880504832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 525us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601348.238259:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789601348.239288:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8312a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880504832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601348.239992:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7edd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8453:1876532880504960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601348.240118:0:8453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601348.240148:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7ed4240 going to sleep for 11 seconds 00000100:00100000:0.0:1789601348.240204:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880504960 00000100:00100000:0.0:1789601348.240212:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880504960 00000100:00100000:0.0:1789601348.240256:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789601348.240264:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:8453:x1876532880504960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601348.240819:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:8453:x1876532880504960:12345-0@lo:502:llog_process_th.0 Request processed in 554us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601348.240827:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789601348.241300:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7edd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8453:1876532880504960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789601348.241332:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601348.241343:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601348.241346:0:8453:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789601348.241363:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789601348.241461:0:8453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7edd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8453:1876532880505088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601348.241509:0:8453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601348.241543:0:8453:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7ed4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789601348.241635:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880505088 00000100:00100000:2.0:1789601348.241641:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880505088 00000100:00100000:2.0:1789601348.241682:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789601348.241689:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:8453:x1876532880505088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601348.241833:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:8453:x1876532880505088:12345-0@lo:502:llog_process_th.0 Request processed in 144us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601348.241860:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789601348.243772:0:8453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7edd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8453:1876532880505088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789601348.243830:0:8453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601348.243859:0:8453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601348.243862:0:8453:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789601348.243867:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1789601348.244094:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1789601348.244123:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789601348.244134:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abf4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601348.244146:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abf4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601348.244156:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789601348.244160:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91edd1466000 from 39 10000000:01000000:2.0:1789601348.244163:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789601348.244197:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abf5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601348.244205:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abf5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601348.244214:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abf5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601348.244235:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880505216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789601348.244305:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601348.244341:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604000 going to sleep for 11 seconds 00000100:00100000:0.0:1789601348.244646:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880505216 00000100:00100000:0.0:1789601348.244654:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880505216 00000100:00100000:0.0:1789601348.244705:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789601348.244715:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:5834:x1876532880505216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789601348.244728:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601348.244741:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc0031800/0xf3d6e402158abf64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abf5d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601348.244770:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc0031800/0xf3d6e402158abf64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abf5d expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601348.244799:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc0031800/0xf3d6e402158abf64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abf5d expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601348.244808:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc0031800, rc 0) 00000100:00100000:0.0:1789601348.244900:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880505216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601348.244907:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789601348.245198:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880505216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601348.245215:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abf5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.245224:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abf5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abf64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601348.245288:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7edd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880505344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601348.245316:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601348.245348:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7ed4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789601348.245399:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880505344 00000100:00100000:2.0:1789601348.245410:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880505344 00000100:00100000:2.0:1789601348.245434:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789601348.245440:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880505344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601348.245722:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880505344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601348.245729:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789601348.245922:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7edd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880505344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601348.245952:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7edd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880505472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601348.245996:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601348.246022:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7ed4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789601348.246181:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880505472 00000100:00100000:2.0:1789601348.246186:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880505472 00000100:00100000:2.0:1789601348.246218:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789601348.246226:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880505472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601348.246524:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880505472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 298us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601348.246531:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789601348.246587:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7edd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880505472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601348.247279:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8454:1876532880505600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601348.247329:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601348.247524:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604480 going to sleep for 11 seconds 00000100:00100000:3.0:1789601348.247750:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880505600 00000100:00100000:3.0:1789601348.247757:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880505600 00000100:00100000:3.0:1789601348.247834:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789601348.247862:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:8454:x1876532880505600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601348.248113:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:8454:x1876532880505600:12345-0@lo:502:llog_process_th.0 Request processed in 252us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601348.248121:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789601348.248213:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8454:1876532880505600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601348.248278:0:8454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc7048000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8454:1876532880505728:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601348.248313:0:8454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601348.251893:0:8454:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03dad80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601348.252125:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880505728 00000100:00100000:2.0:1789601348.252138:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880505728 00000100:00100000:2.0:1789601348.252198:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789601348.252209:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:8454:x1876532880505728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601348.252910:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:8454:x1876532880505728:12345-0@lo:502:llog_process_th.0 Request processed in 701us (4593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601348.252921:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789601348.253794:0:8454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc7048000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8454:1876532880505728:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789601348.253893:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789601348.254215:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789601348.254236:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789601348.254267:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abf5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601348.254279:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abf5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601348.254289:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789601348.254292:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789601348.254295:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789601348.254327:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abf6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601348.254335:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abf6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601348.254495:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abf6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601348.254522:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880505856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789601348.254644:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601348.254684:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789601348.254735:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880505856 00000100:00100000:3.0:1789601348.254748:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880505856 00000100:00100000:3.0:1789601348.254794:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789601348.254802:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880505856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601348.254816:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601348.254828:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edffadd200/0xf3d6e402158abf72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abf6b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.254899:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edffadd200/0xf3d6e402158abf72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abf6b expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.254909:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edffadd200/0xf3d6e402158abf72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abf6b expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.254917:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadd200, rc 0) 00000100:00100000:3.0:1789601348.254957:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880505856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601348.254963:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789601348.255218:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880505856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601348.255233:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abf6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601348.255306:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abf6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abf72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601348.255513:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880505984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601348.255630:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601348.255664:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789601348.255738:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880505984 00000100:00100000:1.0:1789601348.255744:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880505984 00000100:00100000:1.0:1789601348.255783:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789601348.255792:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880505984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601348.256713:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880505984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 919us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601348.256724:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789601348.256823:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880505984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601348.256903:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880506112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601348.256952:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601348.256980:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789601348.257132:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880506112 00000100:00100000:3.0:1789601348.257139:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880506112 00000100:00100000:3.0:1789601348.257181:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789601348.257190:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880506112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601348.257651:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880506112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 462us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601348.257659:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789601348.257891:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880506112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601348.258857:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8455:1876532880506240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601348.258941:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601348.258983:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604240 going to sleep for 11 seconds 00000100:00100000:1.0:1789601348.259115:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880506240 00000100:00100000:1.0:1789601348.259122:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880506240 00000100:00100000:1.0:1789601348.259162:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789601348.259170:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:8455:x1876532880506240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601348.259512:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:8455:x1876532880506240:12345-0@lo:502:llog_process_th.0 Request processed in 342us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601348.259520:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789601348.259684:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8455:1876532880506240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789601348.259717:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601348.259727:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601348.259729:0:8455:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789601348.259736:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789601348.259761:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8455:1876532880506368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601348.259797:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601348.259832:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604240 going to sleep for 11 seconds 00000100:00100000:3.0:1789601348.259929:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880506368 00000100:00100000:3.0:1789601348.259934:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880506368 00000100:00100000:3.0:1789601348.259959:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789601348.259966:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:8455:x1876532880506368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601348.260134:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:8455:x1876532880506368:12345-0@lo:502:llog_process_th.0 Request processed in 168us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601348.260141:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789601348.260443:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8455:1876532880506368:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789601348.260465:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601348.260470:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601348.260472:0:8455:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789601348.260476:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789601348.260741:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1789601348.260758:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789601348.260769:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abf6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.260780:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abf6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601348.260791:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789601348.260794:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91edc6010000 from 1 10000000:01000000:3.0:1789601348.260797:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789601348.260824:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadc000/0xf3d6e402158abf79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.260832:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edffadc000/0xf3d6e402158abf79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601348.260875:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edffadc000/0xf3d6e402158abf79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601348.260903:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7ede680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880506496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789601348.260941:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601348.260963:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc54f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601348.261159:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880506496 00000100:00100000:1.0:1789601348.261166:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880506496 00000100:00100000:1.0:1789601348.261208:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789601348.261216:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880506496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601348.261227:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601348.261238:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc3b89800/0xf3d6e402158abf80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abf79 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601348.261339:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc3b89800/0xf3d6e402158abf80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abf79 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601348.261361:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc3b89800/0xf3d6e402158abf80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abf79 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601348.261369:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b89800, rc 0) 00000100:00100000:1.0:1789601348.261479:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880506496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 264us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601348.261485:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789601348.261523:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7ede680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880506496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601348.261537:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edffadc000/0xf3d6e402158abf79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601348.261652:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edffadc000/0xf3d6e402158abf79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abf80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601348.261714:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8312a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880506624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601348.261741:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601348.261799:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc73439c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601348.263725:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880506624 00000100:00100000:2.0:1789601348.263740:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880506624 00000100:00100000:2.0:1789601348.263860:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789601348.263872:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880506624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601348.269588:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880506624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5708us (7835us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789601348.269605:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789601348.269802:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8312a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880506624:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789601348.269893:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789601348.269905:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadc000/0xf3d6e402158abf79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601348.269919:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edffadc000/0xf3d6e402158abf79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601348.311762:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601348.312247:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858458880 00000100:00100000:3.0:1789601348.312259:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858458880 00000100:00100000:2.0:1789601348.312392:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 163 00000100:00100000:2.0:1789601348.312404:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+8:5599:x1876532858458880:12345-192.168.201.30@tcp:101: 00010000:00010000:2.0:1789601348.312422:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601348.312439:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc29c5a00/0xf3d6e402158abf87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f5060f63 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601348.312468:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c5a00/0xf3d6e402158abf87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f63 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601348.312479:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc29c5a00/0xf3d6e402158abf87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f63 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601348.312488:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c5a00, rc 0) 00000100:00100000:2.0:1789601348.312626:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+9:5599:x1876532858458880:12345-192.168.201.30@tcp:101: Request processed in 223us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601348.312640:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 163 00000100:00100000:3.0:1789601348.317468:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601348.317586:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858459008 00000100:00100000:2.0:1789601348.317609:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858459008 00000100:00100000:2.0:1789601348.317778:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 164 00000100:00100000:2.0:1789601348.317790:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+9:5599:x1876532858459008:12345-192.168.201.30@tcp:501: 00000100:00100000:2.0:1789601348.318325:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+9:5599:x1876532858459008:12345-192.168.201.30@tcp:501: Request processed in 537us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601348.318334:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 164 00000100:00100000:3.0:1789601348.327689:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601348.327911:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858459136 00000100:00100000:2.0:1789601348.327922:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858459136 00000100:00100000:2.0:1789601348.327990:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 165 00000100:00100000:2.0:1789601348.327999:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+9:5599:x1876532858459136:12345-192.168.201.30@tcp:503: 00000100:00100000:2.0:1789601348.328248:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+9:5599:x1876532858459136:12345-192.168.201.30@tcp:503: Request processed in 249us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601348.328256:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 165 00000100:00100000:0.0:1789601348.354022:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601348.354138:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858459264 00000100:00100000:2.0:1789601348.354149:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858459264 00000100:00100000:2.0:1789601348.354213:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 166 00000100:00100000:2.0:1789601348.354224:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+9:6071:x1876532858459264:12345-192.168.201.30@tcp:502: 00000100:00100000:2.0:1789601348.354531:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+9:6071:x1876532858459264:12345-192.168.201.30@tcp:502: Request processed in 308us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601348.354540:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 166 00000100:00100000:3.0:1789601348.361813:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601348.361947:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858459392 00000100:00100000:0.0:1789601348.361958:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858459392 00000100:00100000:0.0:1789601348.362027:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 167 00000100:00100000:0.0:1789601348.362038:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+9:6071:x1876532858459392:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789601348.362330:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+9:6071:x1876532858459392:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 293us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601348.362338:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 167 00000100:00100000:3.0:1789601348.367026:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601348.367444:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858459520 00000100:00100000:1.0:1789601348.367454:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858459520 00000100:00100000:1.0:1789601348.367509:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 168 00000100:00100000:1.0:1789601348.367519:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+9:5599:x1876532858459520:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601348.367536:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601348.367558:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc3b88e00/0xf3d6e402158abf8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f5060f6a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601348.367602:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc3b88e00/0xf3d6e402158abf8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f6a expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601348.367616:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc3b88e00/0xf3d6e402158abf8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f6a expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601348.367625:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88e00, rc 0) 00000100:00100000:1.0:1789601348.367698:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:5599:x1876532858459520:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 180us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601348.367705:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 168 00000100:00100000:3.0:1789601348.371078:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601348.371265:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858459648 00000100:00100000:2.0:1789601348.371278:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858459648 00000100:00100000:2.0:1789601348.371331:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 169 00000100:00100000:2.0:1789601348.371341:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:5599:x1876532858459648:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601348.371760:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:5599:x1876532858459648:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 418us (693us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789601348.371769:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 169 00000100:00100000:0.0:1789601348.553250:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8312a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880506752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601348.553339:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601348.553536:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880506752 00000100:00100000:2.0:1789601348.553545:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880506752 00000100:00100000:2.0:1789601348.553638:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789601348.553649:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc7048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880506752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601348.553685:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789601348.553761:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601348.554438:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc7048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880506752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 787us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601348.554447:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1789601348.557107:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edc8312a00 x1876532880506752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601348.557138:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8312a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880506752:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789601348.617003:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601349.641515:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789601349.882614:0:8492:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc81fb58e0 20000000:00000080:0.0:1789601349.882749:0:8492:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91edf868bc00 uarg=0000000000000000 20000000:01000000:0.0:1789601349.882801:0:8492:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789601349.882809:0:8492:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789601349.882815:0:8492:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789601349.884553:0:8493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789601349.885064:0:8492:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789601349.889439:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789601349.889487:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789601349.889533:0:8492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789601349.889548:0:8492:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789601349.889571:0:8492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91edc0030600/0xf3d6e402158abf95 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601349.889593:0:8492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ee02045600/0xf3d6e402158abd0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abd03 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601349.889604:0:8492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158abd6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abd65 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601349.889610:0:8492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc3b89e00/0xf3d6e402158abe37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abe30 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601349.889625:0:8492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc0030800/0xf3d6e402158abef4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f32 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601349.889634:0:8492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91edc0030600/0xf3d6e402158abf95 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601349.889687:0:8492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc0030800/0xf3d6e402158abef4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f32 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601349.889703:0:8492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91edc0030800/0xf3d6e402158abef4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f32 expref: 9 pid: 5831 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601349.889718:0:8492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc7049180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1876532880506880:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789601349.890081:0:8492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc3b89e00/0xf3d6e402158abe37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abe30 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601349.890090:0:8492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edc3b89e00/0xf3d6e402158abe37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abe30 expref: 18 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601349.890099:0:8492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc7048700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1876532880507008:0@lo:104: 00000100:00100000:0.0:1789601349.890140:0:8492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789601349.890192:0:8492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158abd6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abd65 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601349.890201:0:8492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158abd6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abd65 expref: 18 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601349.890212:0:8492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc704b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1876532880507136:0@lo:104: 00000100:00100000:1.0:1789601349.890242:0:7625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880507008 00000100:00100000:0.0:1789601349.890252:0:8492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601349.890259:0:7625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880507008 00010000:00010000:0.0:1789601349.890297:0:8492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ee02045600/0xf3d6e402158abd0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abd03 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601349.890309:0:8492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91ee02045600/0xf3d6e402158abd0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abd03 expref: 18 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601349.890333:0:8492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc7048e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1876532880507264:0@lo:104: 00000100:00100000:0.0:1789601349.890358:0:8492:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc5386900 going to sleep for 11 seconds 00000100:00100000:1.0:1789601349.890366:0:7625:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789601349.890407:0:7625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601349.890426:0:7625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880507136 00000100:00100000:1.0:1789601349.890430:0:7625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880507136 00000100:00100000:1.0:1789601349.890446:0:7625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880507264 00000100:00100000:1.0:1789601349.890448:0:7625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880507264 00000100:00100000:1.0:1789601349.890480:0:7625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789601349.890491:0:7625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc704b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+5:8492:x1876532880507008:12345-0@lo:104: 00010000:00010000:1.0:1789601349.890512:0:7625:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91ee02044e00/0xf3d6e402158abe30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abe37 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.890614:0:7625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789601349.890621:0:7625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc704b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+5:8492:x1876532880507008:12345-0@lo:104: Request processed in 132us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601349.890629:0:7625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789601349.890651:0:7625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789601349.890658:0:7625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff6d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+4:8492:x1876532880507136:12345-0@lo:104: 00010000:00010000:1.0:1789601349.890667:0:7625:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc29c5800/0xf3d6e402158abd65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abd6c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.890703:0:7625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789601349.890708:0:7625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff6d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+4:8492:x1876532880507136:12345-0@lo:104: Request processed in 51us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601349.890713:0:7625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789601349.890749:0:7625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789601349.890755:0:7625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8312300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:8492:x1876532880507264:12345-0@lo:104: 00010000:00010000:1.0:1789601349.890762:0:7625:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91ee02045e00/0xf3d6e402158abd03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abd0a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.890785:0:7625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789601349.890789:0:7625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8312300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:8492:x1876532880507264:12345-0@lo:104: Request processed in 36us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601349.890795:0:7625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789601349.890817:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789601349.890829:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91ee02044e00/0xf3d6e402158abe30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abe37 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.890881:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee02044e00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601349.890886:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91ee02044e00/0xf3d6e402158abe30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abe37 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.890896:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91ee02044e00/0xf3d6e402158abe30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abe37 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601349.890906:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91ee02044e00/0xf3d6e402158abe30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abe37 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601349.890912:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789601349.890952:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91ee02044e00/0xf3d6e402158abe30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abe37 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.890959:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601349.890983:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91ee02044e00/0xf3d6e402158abe30 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abe37 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.890990:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91ee02044e00/0xf3d6e402158abe30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abe37 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.891005:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789601349.891008:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc29c5800/0xf3d6e402158abd65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abd6c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.891014:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5800 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601349.891017:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c5800/0xf3d6e402158abd65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abd6c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.891034:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc29c5800/0xf3d6e402158abd65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abd6c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601349.891041:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c5800/0xf3d6e402158abd65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abd6c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601349.891047:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789601349.891058:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc29c5800/0xf3d6e402158abd65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abd6c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.891063:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601349.891078:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc29c5800/0xf3d6e402158abd65 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abd6c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.891085:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc29c5800/0xf3d6e402158abd65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abd6c expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.891095:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601349.891097:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91ee02045e00/0xf3d6e402158abd03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abd0a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.891103:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee02045e00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601349.891106:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91ee02045e00/0xf3d6e402158abd03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abd0a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.891113:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91ee02045e00/0xf3d6e402158abd03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abd0a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601349.891119:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91ee02045e00/0xf3d6e402158abd03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abd0a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601349.891129:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789601349.891139:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91ee02045e00/0xf3d6e402158abd03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abd0a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.891145:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601349.891150:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91ee02045e00/0xf3d6e402158abd03 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abd0a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.891158:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91ee02045e00/0xf3d6e402158abd03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abd0a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.891172:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601349.891174:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601349.891175:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601349.891182:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601349.891203:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880507392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601349.891240:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601349.891286:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880507520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601349.891312:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601349.891332:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601349.891337:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8310a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880507648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601349.891358:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601349.891383:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880507392 00000100:00100000:1.0:1789601349.891388:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880507392 00010000:00010000:1.0:1789601349.891412:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc3b89e00/0xf3d6e402158abe37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abe30 expref: 19 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601349.891438:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880507520 00000100:00100000:1.0:1789601349.891448:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880507520 00010000:00010000:1.0:1789601349.891461:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158abd6c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abd65 expref: 20 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601349.891473:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880507648 00000100:00100000:1.0:1789601349.891476:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880507648 00010000:00010000:1.0:1789601349.891485:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ee02045600/0xf3d6e402158abd0a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abd03 expref: 21 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601349.891497:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789601349.891502:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8310e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+21:3318:x1876532880507392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789601349.891514:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601349.891519:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc3b89e00/0xf3d6e402158abe37 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abe30 expref: 21 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.891530:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc3b89e00/0xf3d6e402158abe37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abe30 expref: 21 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.891548:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601349.891575:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8310e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+21:3318:x1876532880507392:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601349.891582:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789601349.891595:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789601349.891600:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8313b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+20:3319:x1876532880507520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789601349.891607:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601349.891611:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158abd6c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abd65 expref: 20 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.891619:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158abd6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abd65 expref: 20 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.891638:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601349.891660:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8313b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+20:3319:x1876532880507520:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601349.891666:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789601349.891677:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789601349.891682:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8313800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3319:x1876532880507648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789601349.891689:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601349.891693:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ee02045600/0xf3d6e402158abd0a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abd03 expref: 19 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.891701:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ee02045600/0xf3d6e402158abd0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abd03 expref: 19 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.891710:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601349.891725:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8313800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3319:x1876532880507648:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601349.891731:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789601349.891779:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880507392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601349.891802:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8310a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880507648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601349.891808:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880507520:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789601349.892090:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc3b89e00/0xf3d6e402158abe37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abe30 expref: 18 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601349.892105:0:8492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc7048700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1876532880507008:0@lo:104: 00010000:00010000:0.0:1789601349.892114:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158abd6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abd65 expref: 17 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601349.892122:0:8492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc704b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1876532880507136:0@lo:104: 00010000:00010000:0.0:1789601349.892131:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ee02045600/0xf3d6e402158abd0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abd03 expref: 16 pid: 5832 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601349.892138:0:8492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc7048e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1876532880507264:0@lo:104: 00000100:00100000:0.0:1789601349.899913:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601349.900004:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858459776 00000100:00100000:3.0:1789601349.900021:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858459776 00000100:00100000:1.0:1789601349.900048:0:8492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc7049180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8492:1876532880506880:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601349.900076:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc0030800/0xf3d6e402158abef4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f32 expref: 10 pid: 5831 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601349.900126:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00010000:00010000:1.0:1789601349.900132:0:8492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91edc0030600/0xf3d6e402158abf95 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601349.900153:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc704bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2357:x1876532858459776:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601349.900173:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601349.900181:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc0030800/0xf3d6e402158abef4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f32 expref: 10 pid: 5831 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601349.900198:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc0030800/0xf3d6e402158abef4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f32 expref: 10 pid: 5831 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601349.900219:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc0030800/0xf3d6e402158abef4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f32 expref: 10 pid: 5831 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601349.900237:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91edc0030600/0xf3d6e402158abf95 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601349.900246:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc0030600/0xf3d6e402158abf95 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601349.900264:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edc0030600/0xf3d6e402158abf95 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601349.900291:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edc0030600/0xf3d6e402158abf95 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601349.900297:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91edc0030600/0xf3d6e402158abf95 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601349.900304:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91edc0030600/0xf3d6e402158abf95 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601349.900309:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030600 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601349.900314:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91edc0030600/0xf3d6e402158abf95 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601349.900322:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91edc0030600/0xf3d6e402158abf95 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601349.900342:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91edc0030600/0xf3d6e402158abf95 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601349.900352:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601349.900420:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc704bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+9:2357:x1876532858459776:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 284us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601349.900428:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00010000:00010000:1.0:1789601349.903084:0:8492:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91edc0030600/0xf3d6e402158abf95 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.903128:0:8492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91edc0030600/0xf3d6e402158abf95 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601349.903136:0:8492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc0030600/0xf3d6e402158abf95 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601350.601269:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880507776:0@lo:400:kworker.0 00000100:00100000:1.0:1789601350.601295:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880508032:0@lo:400:kworker.0 00000100:00100000:2.0:1789601350.601375:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8310a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880507904:0@lo:400:kworker.0 00000100:00100000:3.0:1789601350.601771:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880508160:0@lo:400:kworker.0 00000100:00100000:0.0:1789601350.602064:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601350.602142:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880508288:0@lo:400:kworker.0 00000100:00100000:0.0:1789601350.602176:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601350.602215:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880507776 00000100:00100000:0.0:1789601350.602226:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880507776 00000100:00100000:0.0:1789601350.602282:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789601350.602292:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:3317:x1876532880507776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601350.602347:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:3317:x1876532880507776:12345-0@lo:400:kworker.0 Request processed in 57us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601350.602377:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789601350.602554:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880508288 00000100:00100000:0.0:1789601350.602559:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880508288 00000100:00100000:0.0:1789601350.602609:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789601350.602616:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc704ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880508288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601350.602649:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc704ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880508288:12345-0@lo:400:kworker.0 Request processed in 35us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601350.602655:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789601350.602696:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880508288:0@lo:400:kworker.0 00000100:00100000:0.0:1789601350.602706:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8311500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880507776:0@lo:400:kworker.0 00000100:00080000:0.0:1789601350.602747:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601350.610506:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601350.610594:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8310700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880508416:0@lo:400:kworker.0 00000100:00100000:2.0:1789601350.610646:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601350.610748:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880508416 00000100:00100000:2.0:1789601350.610759:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880508416 00000100:00100000:1.0:1789601350.611035:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789601350.611224:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601350.611245:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880507904 00000100:00100000:1.0:1789601350.611250:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880507904 00000100:00100000:1.0:1789601350.611292:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880508032 00000100:00100000:1.0:1789601350.611295:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880508032 00000100:00100000:1.0:1789601350.611325:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789601350.611336:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880507904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601350.611671:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789601350.611681:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880508416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601350.611777:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789601350.611789:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880508032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601350.613144:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880507904:12345-0@lo:400:kworker.0 Request processed in 1798us (2639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601350.613160:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789601350.613215:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601350.619262:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880508416:12345-0@lo:400:kworker.0 Request processed in 7567us (8598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601350.619284:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789601350.619398:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8310a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880507904:0@lo:400:kworker.0 00010000:00080000:2.0:1789601350.619419:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edc8310700 x1876532880508416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601350.619432:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8310700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880508416:0@lo:400:kworker.0 00000100:00100000:0.0:1789601350.619734:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8311500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880508032:12345-0@lo:400:kworker.0 Request processed in 7946us (8695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601350.619746:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789601350.619961:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8310000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880508032:0@lo:400:kworker.0 00000100:00100000:3.0:1789601350.620510:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601350.623065:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880508160 00000100:00100000:1.0:1789601350.623092:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880508160 00000100:00100000:1.0:1789601350.623202:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789601350.623217:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880508160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601350.623355:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880508160:12345-0@lo:400:kworker.0 Request processed in 142us (2846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601350.623364:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789601350.624024:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789601350.624087:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edc8313480 x1876532880508160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601350.624107:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880508160:0@lo:400:kworker.0 00010000:00010000:1.0:1789601350.667202:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789601350.985193:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789601350.985210:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91edc7b4a800 from 4 10000000:01000000:1.0:1789601350.985217:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789601350.985298:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158abf9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601350.985319:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158abf9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601350.985333:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158abf9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601350.985366:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8310000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880508544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789601350.985455:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601350.985564:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc89ac180 going to sleep for 11 seconds 00000100:00100000:2.0:1789601350.986478:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880508544 00000100:00100000:2.0:1789601350.986493:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880508544 00000100:00100000:3.0:1789601350.986743:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789601350.986758:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:5834:x1876532880508544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601350.986778:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601350.986800:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edffadc200/0xf3d6e402158abfa3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abf9c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601350.986917:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edffadc200/0xf3d6e402158abfa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abf9c expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601350.986934:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edffadc200/0xf3d6e402158abfa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abf9c expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601350.986945:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc200, rc 0) 00000100:00100000:3.0:1789601350.987055:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880508544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 299us (1597us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601350.987063:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789601350.987172:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8310000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880508544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601350.987194:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158abf9c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abfa3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601350.987205:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158abf9c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abfa3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601350.987347:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880508672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601350.987389:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601350.987760:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc6043c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601350.987918:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880508672 00000100:00100000:0.0:1789601350.987926:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880508672 00000100:00100000:0.0:1789601350.987963:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789601350.987972:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880508672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601350.988934:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880508672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 958us (1539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601350.988946:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789601350.989117:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880508672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601350.989182:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc704a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880508800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601350.989238:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601350.989485:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880508800 00000100:00100000:1.0:1789601350.989494:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880508800 00000100:00100000:1.0:1789601350.989531:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789601350.989540:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880508800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601350.989806:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8a1ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789601350.990522:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880508800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 978us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601350.990534:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789601350.990661:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc704a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880508800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601350.991182:0:8514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8311180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8514:1876532880508928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601350.991253:0:8514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601350.991540:0:8514:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc2d61a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601350.991614:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880508928 00000100:00100000:2.0:1789601350.991969:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880508928 00000100:00100000:3.0:1789601350.992125:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789601350.992139:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:8514:x1876532880508928:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601350.996054:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:8514:x1876532880508928:12345-0@lo:502:llog_process_th.0 Request processed in 3901us (4783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601350.996074:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789601350.996321:0:8514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8311180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8514:1876532880508928:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601350.996546:0:8514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601350.996561:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601350.996563:0:8514:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789601350.996573:0:8514:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91edc7b4a800 00000020:00000080:1.0:1789601350.996576:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789601350.996715:0:8514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8311180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8514:1876532880509056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601350.996797:0:8514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601350.996890:0:8514:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd012a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789601350.996975:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880509056 00000100:00100000:0.0:1789601350.996987:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880509056 00000100:00100000:0.0:1789601350.997061:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789601350.997074:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:8514:x1876532880509056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601350.997357:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:8514:x1876532880509056:12345-0@lo:502:llog_process_th.0 Request processed in 285us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601350.997365:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789601350.997655:0:8514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8311180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8514:1876532880509056:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601350.997697:0:8514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601350.997705:0:8514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601350.997707:0:8514:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789601350.997712:0:8514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789601350.999577:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789601350.999622:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789601350.999640:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158abf9c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abfa3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601350.999658:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158abf9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abfa3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601350.999673:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789601350.999677:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91edc825a800 from 4 10000000:01000000:0.0:1789601350.999680:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789601350.999738:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abfaa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601350.999748:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abfaa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601350.999759:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abfaa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601350.999790:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc704a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880509184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789601350.999936:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601351.000012:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8a1b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601351.001590:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880509184 00000100:00100000:1.0:1789601351.001608:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880509184 00000100:00100000:1.0:1789601351.001674:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789601351.001686:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880509184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601351.001709:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601351.001731:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc3b89600/0xf3d6e402158abfb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abfaa expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.001766:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc3b89600/0xf3d6e402158abfb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abfaa expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.001779:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc3b89600/0xf3d6e402158abfb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abfaa expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.001790:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b89600, rc 0) 00000100:00100000:1.0:1789601351.001917:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880509184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (1980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601351.001925:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789601351.002010:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc704a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880509184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601351.002033:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abfaa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abfb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.002044:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abfaa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abfb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601351.002122:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8311180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880509312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601351.002158:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601351.002189:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd012a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601351.002203:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880509312 00000100:00100000:1.0:1789601351.002207:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880509312 00000100:00100000:1.0:1789601351.002224:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789601351.002230:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880509312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601351.003916:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880509312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1671us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601351.003931:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789601351.004685:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8311180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880509312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601351.004771:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc7049880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880509440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601351.004879:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601351.004927:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8a1be40 going to sleep for 11 seconds 00000100:00100000:2.0:1789601351.005553:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880509440 00000100:00100000:2.0:1789601351.005565:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880509440 00000100:00100000:2.0:1789601351.005624:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789601351.005636:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880509440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601351.005942:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880509440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 308us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.005951:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789601351.006022:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc7049880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880509440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601351.013026:0:8516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8516:1876532880509568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601351.013155:0:8516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601351.013795:0:8516:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc6043c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601351.014033:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880509568 00000100:00100000:1.0:1789601351.014046:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880509568 00000100:00100000:1.0:1789601351.014109:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789601351.014121:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:8516:x1876532880509568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601351.015750:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:8516:x1876532880509568:12345-0@lo:502:llog_process_th.0 Request processed in 1622us (2586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601351.015765:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789601351.016009:0:8516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8516:1876532880509568:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789601351.016065:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601351.016079:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601351.016081:0:8516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789601351.016088:0:8516:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91edc825a800 00000020:00000080:2.0:1789601351.016090:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789601351.016211:0:8516:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8516:1876532880509696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601351.016259:0:8516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601351.018464:0:8516:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc6043c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601351.018609:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880509696 00000100:00100000:1.0:1789601351.018621:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880509696 00000100:00100000:1.0:1789601351.018672:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789601351.018681:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:8516:x1876532880509696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601351.019040:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:8516:x1876532880509696:12345-0@lo:502:llog_process_th.0 Request processed in 358us (2778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601351.019050:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789601351.021676:0:8516:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8516:1876532880509696:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789601351.021731:0:8516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601351.021740:0:8516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601351.021742:0:8516:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789601351.021748:0:8516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789601351.022056:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789601351.022095:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789601351.022109:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abfaa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abfb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.022124:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abfaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abfb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601351.022135:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789601351.022138:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91edd1466000 from 4 10000000:01000000:0.0:1789601351.022141:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789601351.022183:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc0030c00/0xf3d6e402158abfb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.022189:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc0030c00/0xf3d6e402158abfb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601351.022198:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc0030c00/0xf3d6e402158abfb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601351.022219:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc7049c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880509824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789601351.022300:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601351.024178:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8a1b600 going to sleep for 11 seconds 00000100:00100000:1.0:1789601351.025888:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880509824 00000100:00100000:1.0:1789601351.025907:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880509824 00000100:00100000:1.0:1789601351.025998:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789601351.026009:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880509824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601351.026030:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601351.026051:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc3b89400/0xf3d6e402158abfbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abfb8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.026081:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc3b89400/0xf3d6e402158abfbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abfb8 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.026089:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc3b89400/0xf3d6e402158abfbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abfb8 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.026097:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b89400, rc 0) 00000100:00100000:1.0:1789601351.026184:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880509824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (3884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601351.026190:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789601351.026258:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc7049c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880509824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601351.026275:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc0030c00/0xf3d6e402158abfb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abfbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.026301:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc0030c00/0xf3d6e402158abfb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abfbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601351.026398:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8312a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880509952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601351.026437:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601351.026464:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd012ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789601351.026476:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880509952 00000100:00100000:1.0:1789601351.026480:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880509952 00000100:00100000:1.0:1789601351.026495:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789601351.026500:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880509952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601351.026752:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880509952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601351.026757:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789601351.026784:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8312a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880509952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601351.026814:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8312a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880510080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601351.026904:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601351.026923:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd012ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789601351.026934:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880510080 00000100:00100000:1.0:1789601351.026937:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880510080 00000100:00100000:1.0:1789601351.026959:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789601351.026965:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880510080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601351.027126:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880510080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601351.027133:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789601351.027179:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8312a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880510080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601351.027362:0:8519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8312a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8519:1876532880510208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601351.027396:0:8519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601351.027413:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880510208 00000100:00100000:1.0:1789601351.027417:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880510208 00000100:00100000:1.0:1789601351.027437:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789601351.027442:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:8519:x1876532880510208:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601351.027542:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:8519:x1876532880510208:12345-0@lo:502:llog_process_th.0 Request processed in 100us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601351.027547:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789601351.027567:0:8519:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd012a180 going to sleep for 11 seconds 00000100:00100000:1.0:1789601351.027575:0:8519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8312a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8519:1876532880510208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601351.027592:0:8519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601351.027602:0:8519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601351.027604:0:8519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789601351.027612:0:8519:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91edd1466000 00000020:00000080:1.0:1789601351.027613:0:8519:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789601351.028124:0:8519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8312a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8519:1876532880510336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601351.028159:0:8519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601351.028180:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880510336 00000100:00100000:1.0:1789601351.028183:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880510336 00000100:00100000:1.0:1789601351.028201:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789601351.028205:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:8519:x1876532880510336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601351.028304:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:8519:x1876532880510336:12345-0@lo:502:llog_process_th.0 Request processed in 98us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601351.028309:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789601351.028345:0:8519:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd012a180 going to sleep for 11 seconds 00000100:00100000:1.0:1789601351.028357:0:8519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8312a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:8519:1876532880510336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601351.028375:0:8519:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601351.028380:0:8519:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601351.028382:0:8519:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789601351.028387:0:8519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789601351.028449:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789601351.028471:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789601351.028480:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc0030c00/0xf3d6e402158abfb8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abfbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601351.028489:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc0030c00/0xf3d6e402158abfb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abfbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601351.121579:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880510464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601351.121676:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601351.121782:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880510464 00000100:00100000:3.0:1789601351.121792:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880510464 00000100:00100000:3.0:1789601351.121884:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789601351.121895:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880510464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789601351.121952:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789601351.122006:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880510464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601351.122014:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789601351.122068:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf7eddc00 x1876532880510464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601351.122092:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7eddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880510464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601351.387083:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601351.387650:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858459904 00000100:00100000:2.0:1789601351.387669:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858459904 00000100:00100000:2.0:1789601351.387776:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 186 00000100:00100000:2.0:1789601351.387791:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+9:5599:x1876532858459904:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601351.387813:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601351.387874:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158abfc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f5060f71 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.387916:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158abfc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f71 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.387932:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158abfc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f71 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601351.387944:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c4a00, rc 0) 00000100:00100000:2.0:1789601351.388034:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:5599:x1876532858459904:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 247us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.388043:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 186 00000100:00100000:3.0:1789601351.394731:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601351.395694:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858460032 00000100:00100000:2.0:1789601351.395712:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858460032 00000100:00100000:2.0:1789601351.395779:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 187 00000100:00100000:2.0:1789601351.395792:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:5599:x1876532858460032:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601351.396283:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:5599:x1876532858460032:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 491us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.396293:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 187 00000100:00100000:1.0:1789601351.403962:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601351.404570:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858460160 00000100:00100000:0.0:1789601351.404586:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858460160 00000100:00100000:0.0:1789601351.404657:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 188 00000100:00100000:0.0:1789601351.404668:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:5599:x1876532858460160:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601351.404938:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:5599:x1876532858460160:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 272us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601351.404946:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 188 00000100:00100000:2.0:1789601351.409119:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601351.411089:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858460288 00000100:00100000:1.0:1789601351.411105:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858460288 00000100:00100000:1.0:1789601351.411166:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 189 00000100:00100000:1.0:1789601351.411177:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:6129:x1876532858460288:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789601351.411453:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:6129:x1876532858460288:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 276us (2343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601351.411463:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 189 00000100:00100000:0.0:1789601351.427128:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601351.429612:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858460416 00000100:00100000:2.0:1789601351.429630:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858460416 00000100:00100000:2.0:1789601351.429794:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 190 00000100:00100000:2.0:1789601351.429806:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:6129:x1876532858460416:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789601351.431015:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:6129:x1876532858460416:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 1204us (3887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.431027:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 190 00000100:00100000:0.0:1789601351.653587:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601351.656904:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601351.656988:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601351.657057:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858460544 00000100:00100000:1.0:1789601351.657068:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858460544 00000100:00100000:1.0:1789601351.657136:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:1.0:1789601351.657146:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc7049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858460544:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789601351.657256:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc7049c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858460544:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 112us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601351.657280:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00080000:1.0:1789601351.657332:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601351.672151:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858460672 00000100:00100000:2.0:1789601351.672169:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858460672 00000100:00100000:2.0:1789601351.672272:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858460800 00000100:00100000:2.0:1789601351.672276:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858460800 00000100:00100000:2.0:1789601351.672303:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:2.0:1789601351.672321:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc7049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2357:x1876532858460672:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601351.672430:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc7049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2357:x1876532858460672:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 118us (18855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.672438:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:2.0:1789601351.672455:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:2.0:1789601351.672462:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc7049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2356:x1876532858460800:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601351.672487:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc7049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2356:x1876532858460800:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (15499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601351.672493:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00080000:0.0:1789601351.675379:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601351.675389:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789601351.704348:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601352.714026:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601353.675459:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789601353.675494:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8312a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880510592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601353.675697:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601353.675949:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880510592 00000100:00100000:3.0:1789601353.675965:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880510592 00000100:00100000:3.0:1789601353.676242:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789601353.676252:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc704a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880510592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789601353.676289:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789601353.676388:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc704a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880510592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601353.676394:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789601353.677974:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edc8312a00 x1876532880510592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601353.678011:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8312a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880510592:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789601353.678740:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789601353.737461:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601354.761177:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601355.726011:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8312a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880510720:0@lo:400:kworker.0 00000100:00100000:1.0:1789601355.726095:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601355.726162:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880511232:0@lo:400:kworker.0 00000100:00100000:1.0:1789601355.726192:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601355.726222:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789601355.726229:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880510848:0@lo:400:kworker.0 00000100:00100000:1.0:1789601355.726251:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601355.726270:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8311c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880511360:0@lo:400:kworker.0 00000100:00100000:1.0:1789601355.726293:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601355.726320:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880510976:0@lo:400:kworker.0 00000100:00100000:1.0:1789601355.726344:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601355.726362:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601355.726366:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8311880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880511104:0@lo:400:kworker.0 00000100:00100000:1.0:1789601355.726387:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601355.726419:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880510720 00000100:00100000:1.0:1789601355.726427:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880510720 00000100:00100000:1.0:1789601355.726475:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789601355.726485:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880510720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601355.726546:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880510720:12345-0@lo:400:kworker.0 Request processed in 62us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601355.726553:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789601355.726591:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880511232 00000100:00100000:1.0:1789601355.726595:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880511232 00000100:00100000:1.0:1789601355.726629:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880510848 00000100:00100000:1.0:1789601355.726632:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880510848 00000100:00100000:1.0:1789601355.726645:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880510976 00000100:00100000:1.0:1789601355.726648:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880510976 00000100:00100000:1.0:1789601355.726662:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789601355.726668:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880511232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601355.726698:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8311f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880511232:12345-0@lo:400:kworker.0 Request processed in 31us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601355.726705:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789601355.726718:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789601355.726723:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880510848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601355.726758:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8313100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880510848:12345-0@lo:400:kworker.0 Request processed in 34us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601355.726763:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789601355.726775:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789601355.726781:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880510976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601355.726811:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8310000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880510976:12345-0@lo:400:kworker.0 Request processed in 31us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601355.726817:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1789601355.726874:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601355.726907:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8310380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880510976:0@lo:400:kworker.0 00000100:00100000:1.0:1789601355.726945:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8312680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880510848:0@lo:400:kworker.0 00000100:00100000:1.0:1789601355.726953:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8312a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880510720:0@lo:400:kworker.0 00000100:00100000:1.0:1789601355.726961:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880511232:0@lo:400:kworker.0 00000100:00100000:2.0:1789601355.730113:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880511360 00000100:00100000:2.0:1789601355.730140:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880511360 00000100:00100000:2.0:1789601355.730206:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880511104 00000100:00100000:2.0:1789601355.730209:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880511104 00000100:00100000:2.0:1789601355.730228:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789601355.730237:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8311180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880511360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601355.730328:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8311180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880511360:12345-0@lo:400:kworker.0 Request processed in 92us (4033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601355.730334:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789601355.730349:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789601355.730355:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880511104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601355.730390:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8313480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880511104:12345-0@lo:400:kworker.0 Request processed in 36us (4003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601355.730395:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1789601355.730430:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789601355.730434:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789601355.730466:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edc8311c00 x1876532880511360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601355.730479:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8311c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880511360:0@lo:400:kworker.0 00010000:00080000:2.0:1789601355.730515:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edc8311880 x1876532880511104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601355.730524:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8311880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880511104:0@lo:400:kworker.0 00010000:00010000:3.0:1789601355.785473:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601356.244693:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601356.244720:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880511488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601356.244801:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601356.245050:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880511488 00000100:00100000:0.0:1789601356.245059:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880511488 00000100:00100000:0.0:1789601356.245108:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789601356.245117:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880511488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789601356.245156:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789601356.245199:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7eddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880511488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601356.245205:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789601356.246047:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8ed80 x1876532880511488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601356.246069:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880511488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601356.756671:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601356.756704:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601356.756744:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601356.756772:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601356.756800:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858461184 00000100:00100000:3.0:1789601356.756811:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858461184 00000100:00100000:3.0:1789601356.756899:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858461312 00000100:00100000:3.0:1789601356.756903:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858461312 00000100:00100000:3.0:1789601356.756924:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:3.0:1789601356.756933:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2357:x1876532858461184:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789601356.757155:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858460928 00000100:00100000:1.0:1789601356.757159:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858460928 00000100:00100000:1.0:1789601356.757189:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 192 00000100:00100000:1.0:1789601356.757196:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2357:x1876532858460928:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789601356.757271:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2357:x1876532858460928:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 74us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601356.757278:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 192 00000100:00100000:3.0:1789601356.757464:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7ede300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2357:x1876532858461184:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 531us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601356.757471:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:3.0:1789601356.757485:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:3.0:1789601356.757492:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2357:x1876532858461312:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601356.757523:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2357:x1876532858461312:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601356.757528:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:3.0:1789601356.757550:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858461056 00000100:00100000:3.0:1789601356.757554:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858461056 00000100:00100000:3.0:1789601356.757592:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:3.0:1789601356.757599:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858461056:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601356.757626:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858461056:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601356.757631:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00080000:3.0:1789601356.757664:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601356.757669:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601356.757670:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789601356.816656:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601357.835517:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789601358.135831:0:8791:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1789601358.804924:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880511616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601358.805014:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601358.805267:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880511616 00000100:00100000:0.0:1789601358.805278:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880511616 00000100:00100000:0.0:1789601358.805525:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789601358.805539:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8312a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880511616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789601358.805584:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789601358.805648:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8312a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880511616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601358.805656:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789601358.806189:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789601358.813564:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edc8312d80 x1876532880511616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601358.813604:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8312d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880511616:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789601358.857358:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601359.884240:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601360.851802:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880512000:0@lo:400:kworker.0 00000100:00100000:1.0:1789601360.851926:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601360.852230:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880511872:0@lo:400:kworker.0 00000100:00100000:0.0:1789601360.852270:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601360.852304:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601360.852311:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880511744:0@lo:400:kworker.0 00000100:00100000:0.0:1789601360.852344:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601360.856185:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601360.856218:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880512128:0@lo:400:kworker.0 00000100:00100000:1.0:1789601360.856338:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601360.856451:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880512000 00000100:00100000:1.0:1789601360.856463:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880512000 00000100:00100000:0.0:1789601360.857833:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880512128 00000100:00100000:0.0:1789601360.857870:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880512128 00000100:00100000:1.0:1789601360.858133:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880511872 00000100:00100000:1.0:1789601360.858157:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880511872 00000100:00100000:1.0:1789601360.858191:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789601360.858203:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880512000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601360.858319:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8312d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880512000:12345-0@lo:400:kworker.0 Request processed in 118us (6392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601360.858327:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789601360.858357:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789601360.858363:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc7049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880511872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601360.858420:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc7049180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880511872:12345-0@lo:400:kworker.0 Request processed in 58us (6149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601360.858427:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789601360.858467:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880511744 00000100:00100000:1.0:1789601360.858472:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880511744 00000100:00100000:1.0:1789601360.858514:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789601360.858521:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3318:x1876532880511744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601360.858556:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3318:x1876532880511744:12345-0@lo:400:kworker.0 Request processed in 37us (6211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601360.858563:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789601360.863352:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7edd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880512256:0@lo:400:kworker.0 00000100:00100000:0.0:1789601360.871860:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789601360.871889:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8312680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880512128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601360.872029:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8312680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880512128:12345-0@lo:400:kworker.0 Request processed in 152us (15691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601360.872037:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789601360.872039:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601360.872096:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601360.872111:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880512384:0@lo:400:kworker.0 00000100:00100000:3.0:1789601360.872154:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601360.872307:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880512384 00000100:00100000:0.0:1789601360.872318:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880512384 00000100:00100000:0.0:1789601360.872360:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789601360.872368:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880512384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601360.872407:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880512384:12345-0@lo:400:kworker.0 Request processed in 40us (251us total) trans 0 rc 0/0 00010000:00080000:3.0:1789601360.872568:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf7ede680 x1876532880512384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601360.872587:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7ede680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880512384:0@lo:400:kworker.0 00000100:00100000:0.0:1789601360.872648:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1789601360.874466:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601360.874519:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880512256 00000100:00100000:1.0:1789601360.874532:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880512256 00000100:00100000:1.0:1789601360.874609:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789601360.874620:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880512256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601360.874763:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880512256:12345-0@lo:400:kworker.0 Request processed in 145us (2722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601360.874770:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789601360.874914:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7edd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880512256:0@lo:400:kworker.0 00000100:00100000:1.0:1789601360.875241:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7edce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880511744:0@lo:400:kworker.0 00000100:00100000:1.0:1789601360.875280:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880511872:0@lo:400:kworker.0 00010000:00080000:1.0:1789601360.875322:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf7edf480 x1876532880512128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601360.875333:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7edf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880512128:0@lo:400:kworker.0 00000100:00100000:1.0:1789601360.875349:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7edf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880512000:0@lo:400:kworker.0 00000100:00080000:1.0:1789601360.875379:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789601360.875484:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789601360.907002:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601361.354330:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880512512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601361.354439:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601361.357001:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880512512 00000100:00100000:2.0:1789601361.357021:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880512512 00000100:00100000:2.0:1789601361.357104:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789601361.357129:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880512512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601361.357184:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601361.362978:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880512512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5836us (8523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601361.362999:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1789601361.366622:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8dc00 x1876532880512512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601361.366674:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880512512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601361.879624:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601361.879691:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601361.879725:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858461568 00000100:00100000:3.0:1789601361.879736:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858461568 00000100:00100000:3.0:1789601361.879800:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:3.0:1789601361.879811:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2359:x1876532858461568:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601361.879928:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7ede680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2359:x1876532858461568:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 120us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601361.879936:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00080000:3.0:1789601361.879957:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601361.881176:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858461440 00000100:00100000:0.0:1789601361.881186:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858461440 00000100:00100000:0.0:1789601361.881252:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 194 00000100:00100000:0.0:1789601361.881261:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2359:x1876532858461440:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601361.881330:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2359:x1876532858461440:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 71us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601361.881337:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 194 00000100:00100000:3.0:1789601361.884158:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601361.884492:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858461696 00000100:00100000:2.0:1789601361.884504:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858461696 00000100:00100000:2.0:1789601361.884571:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:2.0:1789601361.884581:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2355:x1876532858461696:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:2.0:1789601361.884618:0:6677:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abf02 00000100:00080000:2.0:1789601361.884628:0:6677:0:(import.c:65:import_set_state_nolock()) ffff91edf8ac1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789601361.884679:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789601361.885051:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+2:2355:x1876532858461696:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 471us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601361.885059:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00010000:00010000:2.0:1789601361.885118:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789601361.885126:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601361.903931:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601361.903967:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858461824 00000100:00100000:0.0:1789601361.903977:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858461824 00000100:00100000:0.0:1789601361.904037:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1789601361.904049:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc7048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2355:x1876532858461824:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:0.0:1789601361.904087:0:6676:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abf09 00000100:00080000:0.0:1789601361.904097:0:6676:0:(import.c:65:import_set_state_nolock()) ffff91edf8ac2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789601361.904137:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789601361.908490:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc7048e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+2:2355:x1876532858461824:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 4432us (4557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601361.908505:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00080000:0.0:1789601361.908546:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789601361.908593:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601361.930771:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601362.961784:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789601363.620428:0:9035:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing yml_node 00000100:00100000:1.0:1789601363.918247:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc704b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880512640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601363.918334:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601363.918508:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880512640 00000100:00100000:0.0:1789601363.918517:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880512640 00000100:00100000:0.0:1789601363.918587:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789601363.918609:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8310380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880512640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789601363.918657:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789601363.918707:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8310380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880512640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601363.918715:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1789601363.919112:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789601363.919145:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edc704b480 x1876532880512640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601363.919164:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc704b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880512640:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789601363.984060:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601365.007095:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789601365.532361:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 00000020:00000080:0.0:1789601365.532372:0:6703:0:(genops.c:885:class_export_put()) final put ffff91edf8ac0000/701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 00000020:00000080:2.0:1789601365.532625:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91edf8ac0000/701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 for lustre-OST0000 00000020:00000080:2.0:1789601365.532785:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91edf8ac1800 for lustre-OST0000 00000100:00100000:1.0:1789601365.964696:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8311c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880513152:0@lo:400:kworker.0 00000100:00100000:1.0:1789601365.964766:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601365.964871:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601365.964878:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8311880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880513024:0@lo:400:kworker.0 00000100:00100000:1.0:1789601365.964906:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601365.964941:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880513152 00000100:00100000:1.0:1789601365.964949:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880513152 00000100:00100000:1.0:1789601365.965007:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789601365.965017:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880513152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601365.965080:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880513152:12345-0@lo:400:kworker.0 Request processed in 65us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601365.965102:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789601365.965132:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880513024 00000100:00100000:1.0:1789601365.965136:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880513024 00000100:00100000:1.0:1789601365.965162:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789601365.965168:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880513024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601365.965202:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880513024:12345-0@lo:400:kworker.0 Request processed in 33us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601365.965208:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1789601365.965227:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789601365.965246:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601365.965282:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8311880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880513024:0@lo:400:kworker.0 00000100:00100000:3.0:1789601365.965475:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8310700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880512768:0@lo:400:kworker.0 00000100:00100000:3.0:1789601365.965512:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601365.965540:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880513280:0@lo:400:kworker.0 00000100:00100000:3.0:1789601365.965578:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601365.965599:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789601365.965605:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8310a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880512896:0@lo:400:kworker.0 00000100:00100000:3.0:1789601365.965628:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601365.965645:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880513408:0@lo:400:kworker.0 00000100:00100000:3.0:1789601365.965666:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601365.965693:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880513280 00000100:00100000:3.0:1789601365.965697:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880513280 00000100:00100000:3.0:1789601365.965725:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880512896 00000100:00100000:3.0:1789601365.965728:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880512896 00000100:00100000:3.0:1789601365.965748:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789601365.965754:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880513280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601365.965803:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880513280:12345-0@lo:400:kworker.0 Request processed in 37us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601365.965810:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789601365.965823:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789601365.965829:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880512896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601365.965892:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880512896:12345-0@lo:400:kworker.0 Request processed in 63us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601365.965898:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789601365.965929:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8310a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880512896:0@lo:400:kworker.0 00000100:00100000:3.0:1789601365.965940:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880513280:0@lo:400:kworker.0 00000100:00100000:3.0:1789601365.965985:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880512768 00000100:00100000:3.0:1789601365.965988:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880512768 00000100:00100000:3.0:1789601365.966011:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789601365.966017:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880512768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601365.966052:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880512768:12345-0@lo:400:kworker.0 Request processed in 35us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601365.966059:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:3.0:1789601365.966081:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601365.966098:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8310700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880512768:0@lo:400:kworker.0 00000100:00100000:0.0:1789601365.966986:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880513408 00000100:00100000:0.0:1789601365.966993:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880513408 00000100:00100000:0.0:1789601365.967038:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789601365.967045:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880513408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601365.967123:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880513408:12345-0@lo:400:kworker.0 Request processed in 78us (1455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601365.967129:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1789601365.967149:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789601365.967174:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00c6b800 x1876532880513408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601365.967187:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880513408:0@lo:400:kworker.0 00010000:00080000:1.0:1789601365.968599:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edc8311c00 x1876532880513152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601365.968617:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8311c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880513152:0@lo:400:kworker.0 00000001:00100000:1.0:1789601366.002363:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 00000020:00000080:1.0:1789601366.002372:0:7635:0:(genops.c:885:class_export_put()) final put ffff91edf8ac7000/701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 00000020:00000080:3.0:1789601366.002442:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91edf8ac7000/701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 for lustre-OST0001 00000020:00000080:3.0:1789601366.002495:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91edf8ac2800 for lustre-OST0001 00010000:00010000:0.0:1789601366.025012:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601366.473437:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880513536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601366.473509:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601366.473649:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880513536 00000100:00100000:0.0:1789601366.473658:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880513536 00000100:00100000:0.0:1789601366.473721:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789601366.473731:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880513536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789601366.473764:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789601366.474299:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880513536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 568us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601366.474463:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789601366.474596:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8ea00 x1876532880513536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601366.474617:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880513536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601367.013054:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601367.013111:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601367.013269:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858461952 00000100:00100000:2.0:1789601367.013281:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858461952 00000100:00100000:2.0:1789601367.013345:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 196 00000100:00100000:2.0:1789601367.013365:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2359:x1876532858461952:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601367.013443:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2359:x1876532858461952:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 91us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601367.013450:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 196 00000100:00100000:3.0:1789601367.015723:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858462080 00000100:00100000:3.0:1789601367.015737:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858462080 00000100:00100000:3.0:1789601367.015922:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:3.0:1789601367.015944:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc7048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2359:x1876532858462080:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601367.016246:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc7048700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2359:x1876532858462080:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 303us (3140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601367.016254:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00080000:0.0:1789601367.022773:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789601367.049610:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601368.079078:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789601368.476097:0:9228:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00000100:00100000:3.0:1789601369.034133:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601369.034168:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880513664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601369.034279:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601369.034578:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880513664 00000100:00100000:1.0:1789601369.034589:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880513664 00000100:00100000:1.0:1789601369.034689:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789601369.034700:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880513664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601369.034748:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601369.034817:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880513664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601369.034855:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1789601369.034933:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00c80a80 x1876532880513664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601369.034955:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880513664:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789601369.035734:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789601369.101122:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601370.121266:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601371.081703:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880513792:0@lo:400:kworker.0 00000100:00100000:2.0:1789601371.081745:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880514048:0@lo:400:kworker.0 00000100:00100000:1.0:1789601371.081863:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880513920:0@lo:400:kworker.0 00000100:00100000:0.0:1789601371.082382:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880514176:0@lo:400:kworker.0 00000100:00100000:2.0:1789601371.087493:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601371.087596:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880514048 00000100:00100000:2.0:1789601371.087605:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880514048 00000100:00100000:2.0:1789601371.087658:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789601371.087668:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880514048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601371.087727:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880514048:12345-0@lo:400:kworker.0 Request processed in 62us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601371.087735:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1789601371.087757:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601371.087811:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880514048:0@lo:400:kworker.0 00000100:00100000:3.0:1789601371.098781:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601371.098960:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880514304:0@lo:400:kworker.0 00000100:00100000:3.0:1789601371.099058:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601371.099104:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880514304 00000100:00100000:3.0:1789601371.099116:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880514304 00000100:00100000:2.0:1789601371.099267:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880513792 00000100:00100000:2.0:1789601371.099273:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880513792 00000100:00100000:2.0:1789601371.099330:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789601371.099341:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880513792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601371.099421:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880513792:12345-0@lo:400:kworker.0 Request processed in 80us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601371.099430:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789601371.099531:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880513792:0@lo:400:kworker.0 00000100:00100000:3.0:1789601371.099718:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789601371.099726:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880514304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601371.099772:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880514304:12345-0@lo:400:kworker.0 Request processed in 47us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601371.099778:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789601371.099812:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880514304:0@lo:400:kworker.0 00000100:00080000:2.0:1789601371.100045:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601371.100691:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601371.100734:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880513920 00000100:00100000:3.0:1789601371.100744:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880513920 00000100:00100000:1.0:1789601371.100751:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880514432:0@lo:400:kworker.0 00000100:00100000:1.0:1789601371.107508:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601371.107531:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789601371.107580:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880513920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601371.107719:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880513920:12345-0@lo:400:kworker.0 Request processed in 160us (7038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601371.108006:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880514432 00000100:00100000:1.0:1789601371.108017:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880514432 00000100:00100000:1.0:1789601371.108094:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789601371.108106:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880514432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601371.108932:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880514432:12345-0@lo:400:kworker.0 Request processed in 825us (8128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601371.108943:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789601371.108980:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789601371.109020:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8f800 x1876532880514432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601371.109034:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880514432:0@lo:400:kworker.0 00000100:00100000:1.0:1789601371.109066:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880513920:0@lo:400:kworker.0 00000100:00100000:1.0:1789601371.109092:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601371.109791:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880514176 00000100:00100000:0.0:1789601371.109809:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880514176 00000100:00100000:0.0:1789601371.109928:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789601371.109942:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880514176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601371.110041:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880514176:12345-0@lo:400:kworker.0 Request processed in 104us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601371.110049:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789601371.112319:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789601371.112413:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8ce00 x1876532880514176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601371.112437:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880514176:0@lo:400:kworker.0 00000100:00100000:3.0:1789601371.117430:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:0.0:1789601371.145132:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789601371.449440:0:9327:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00000100:00100000:2.0:1789601371.597751:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880514560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601371.597867:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601371.597976:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880514560 00000100:00100000:2.0:1789601371.597986:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880514560 00000100:00100000:2.0:1789601371.598040:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789601371.598051:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880514560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601371.598099:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601371.598152:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880514560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601371.598159:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789601371.598210:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8e300 x1876532880514560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601371.598233:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880514560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601372.120933:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601372.120998:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601372.121115:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858462208 00000100:00100000:2.0:1789601372.121130:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858462208 00000100:00100000:2.0:1789601372.121202:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 198 00000100:00100000:2.0:1789601372.121216:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2356:x1876532858462208:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601372.121305:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2356:x1876532858462208:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 92us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601372.121313:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 198 00000100:00100000:3.0:1789601372.121877:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858462336 00000100:00100000:3.0:1789601372.121884:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858462336 00000100:00100000:3.0:1789601372.121948:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:3.0:1789601372.121957:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858462336:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601372.122017:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858462336:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 61us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601372.122025:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00080000:1.0:1789601372.122107:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789601372.169045:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601373.193290:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601374.158592:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601374.158625:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880514688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601374.158744:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601374.158831:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880514688 00000100:00100000:1.0:1789601374.158876:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880514688 00000100:00100000:1.0:1789601374.158951:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789601374.158962:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880514688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601374.159010:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601374.159080:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880514688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601374.159088:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789601374.159117:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789601374.159160:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edd8deb800 x1876532880514688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601374.159187:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8deb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880514688:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789601374.217305:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789601374.942200:0:9424:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:0.0:1789601375.245101:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601376.207184:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880515072:0@lo:400:kworker.0 00000100:00100000:1.0:1789601376.207263:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601376.207339:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601376.207355:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880515200:0@lo:400:kworker.0 00000100:00100000:1.0:1789601376.207414:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601376.207462:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880515200 00000100:00100000:1.0:1789601376.207473:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880515200 00000100:00100000:1.0:1789601376.207766:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789601376.207776:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880515200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601376.207829:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880515200:12345-0@lo:400:kworker.0 Request processed in 55us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601376.207855:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1789601376.207878:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789601376.207919:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00a3df80 x1876532880515200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601376.207932:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880515200:0@lo:400:kworker.0 00000100:00100000:2.0:1789601376.208018:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880514816:0@lo:400:kworker.0 00000100:00100000:2.0:1789601376.208058:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601376.208095:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880515328:0@lo:400:kworker.0 00000100:00100000:2.0:1789601376.208119:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601376.208140:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789601376.208147:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880514944:0@lo:400:kworker.0 00000100:00100000:2.0:1789601376.208184:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601376.208208:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880515456:0@lo:400:kworker.0 00000100:00100000:2.0:1789601376.208228:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601376.208257:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880515072 00000100:00100000:2.0:1789601376.208262:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880515072 00000100:00100000:2.0:1789601376.208300:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880515328 00000100:00100000:2.0:1789601376.208304:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880515328 00000100:00100000:2.0:1789601376.208316:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880514944 00000100:00100000:2.0:1789601376.208318:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880514944 00000100:00100000:2.0:1789601376.208330:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789601376.208336:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880515072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601376.208396:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880515072:12345-0@lo:400:kworker.0 Request processed in 60us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601376.208403:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789601376.208416:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789601376.208422:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880515328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601376.208469:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880515328:12345-0@lo:400:kworker.0 Request processed in 43us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601376.208475:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789601376.208492:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789601376.208498:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880514944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601376.208828:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880514944:12345-0@lo:400:kworker.0 Request processed in 330us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601376.208873:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789601376.208903:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880515456 00000100:00100000:2.0:1789601376.208908:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880515456 00000100:00100000:2.0:1789601376.208934:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789601376.208949:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880515456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601376.208981:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880515456:12345-0@lo:400:kworker.0 Request processed in 33us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601376.208986:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789601376.209005:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789601376.209010:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601376.209039:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880514944:0@lo:400:kworker.0 00010000:00080000:2.0:1789601376.209050:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00a3f100 x1876532880515456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601376.209059:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880515456:0@lo:400:kworker.0 00000100:00100000:2.0:1789601376.209069:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880515328:0@lo:400:kworker.0 00000100:00100000:2.0:1789601376.209098:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880515072:0@lo:400:kworker.0 00000100:00100000:1.0:1789601376.210248:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880514816 00000100:00100000:1.0:1789601376.210261:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880514816 00000100:00100000:1.0:1789601376.210321:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789601376.210330:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880514816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601376.210419:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880514816:12345-0@lo:400:kworker.0 Request processed in 90us (2360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601376.210425:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789601376.210484:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880514816:0@lo:400:kworker.0 00010000:00010000:0.0:1789601376.269250:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601376.713778:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880515584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601376.716551:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601376.716657:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880515584 00000100:00100000:2.0:1789601376.716667:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880515584 00000100:00100000:2.0:1789601376.716717:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789601376.716727:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880515584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601376.716767:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601376.716827:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880515584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601376.716849:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789601376.716900:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8e680 x1876532880515584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601376.716935:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880515584:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1789601376.717215:0:9473:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 16 19:29:36 EDT 2026 00000100:00100000:1.0:1789601377.239677:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601377.239744:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601377.240157:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858462592 00000100:00100000:3.0:1789601377.240169:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858462592 00000100:00100000:3.0:1789601377.240255:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:3.0:1789601377.240266:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858462592:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601377.240339:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858462592:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 76us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601377.240347:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00080000:1.0:1789601377.240451:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601377.240761:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858462464 00000100:00100000:2.0:1789601377.240767:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858462464 00000100:00100000:2.0:1789601377.240807:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 200 00000100:00100000:2.0:1789601377.240814:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2357:x1876532858462464:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601377.240877:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2357:x1876532858462464:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 63us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601377.240884:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 200 00010000:00010000:0.0:1789601377.292602:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601378.323626:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601379.273974:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880515712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601379.274043:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601379.274116:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880515712 00000100:00100000:1.0:1789601379.274124:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880515712 00000100:00100000:1.0:1789601379.274178:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789601379.274188:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880515712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601379.274224:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601379.274270:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880515712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601379.274277:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1789601379.274310:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789601379.274356:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00a5b480 x1876532880515712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601379.274376:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880515712:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789601379.337042:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601380.363046:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601381.336802:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880516096:0@lo:400:kworker.0 00000100:00100000:3.0:1789601381.336872:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880515840:0@lo:400:kworker.0 00000100:00100000:1.0:1789601381.336926:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601381.336927:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601381.337006:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880515968:0@lo:400:kworker.0 00000100:00100000:2.0:1789601381.337010:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880516096 00000100:00100000:2.0:1789601381.337028:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880516096 00000100:00100000:0.0:1789601381.337038:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601381.337083:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880516224:0@lo:400:kworker.0 00000100:00100000:2.0:1789601381.337089:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880515968 00000100:00100000:2.0:1789601381.337093:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880515968 00000100:00100000:2.0:1789601381.337116:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789601381.337127:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880516096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601381.337133:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789601381.337164:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601381.337190:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880516096:12345-0@lo:400:kworker.0 Request processed in 64us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601381.337194:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789601381.337204:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789601381.337209:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc704b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880515968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601381.337233:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880516224 00000100:00100000:2.0:1789601381.337238:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880516224 00000100:00100000:0.0:1789601381.337250:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc704b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880515968:12345-0@lo:400:kworker.0 Request processed in 45us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601381.337257:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789601381.337279:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789601381.337300:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc704b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880516224:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789601381.337309:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601381.337327:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880515840 00000100:00100000:0.0:1789601381.337332:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880515840 00000100:00100000:2.0:1789601381.337349:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc704b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880516224:12345-0@lo:400:kworker.0 Request processed in 61us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601381.337357:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789601381.337363:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789601381.337373:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880515840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601381.337406:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880515840:12345-0@lo:400:kworker.0 Request processed in 35us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601381.337413:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789601381.337579:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880515840:0@lo:400:kworker.0 00000100:00100000:3.0:1789601381.337588:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880516352:0@lo:400:kworker.0 00000100:00100000:3.0:1789601381.337613:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601381.337727:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880515968:0@lo:400:kworker.0 00000100:00100000:0.0:1789601381.337734:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880516480:0@lo:400:kworker.0 00000100:00100000:0.0:1789601381.337771:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601381.337816:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880516480 00000100:00100000:0.0:1789601381.337820:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880516480 00000100:00100000:0.0:1789601381.337866:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789601381.337873:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880516480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601381.337907:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880516480:12345-0@lo:400:kworker.0 Request processed in 35us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601381.337912:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1789601381.337927:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789601381.337951:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8f800 x1876532880516480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601381.337962:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880516480:0@lo:400:kworker.0 00010000:00080000:3.0:1789601381.338256:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8ce00 x1876532880516224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601381.338279:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880516224:0@lo:400:kworker.0 00000100:00100000:2.0:1789601381.338353:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880516352 00000100:00100000:2.0:1789601381.338364:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880516352 00000100:00100000:2.0:1789601381.338417:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789601381.338424:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880516352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601381.338460:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8311c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880516352:12345-0@lo:400:kworker.0 Request processed in 37us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601381.338466:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1789601381.338587:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601381.338779:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880516352:0@lo:400:kworker.0 00000100:00100000:1.0:1789601381.339478:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880516096:0@lo:400:kworker.0 00010000:00010000:0.0:1789601381.387075:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601381.834432:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601381.834455:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880516608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601381.834523:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601381.834579:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880516608 00000100:00100000:2.0:1789601381.834586:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880516608 00000100:00100000:2.0:1789601381.834625:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789601381.834633:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880516608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601381.834675:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601381.834715:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880516608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601381.834722:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789601381.834763:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8fb80 x1876532880516608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601381.834779:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880516608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601382.360045:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601382.360095:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601382.360132:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858462720 00000100:00100000:0.0:1789601382.360133:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858462848 00000100:00100000:3.0:1789601382.360141:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858462720 00000100:00100000:0.0:1789601382.360141:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858462848 00000100:00100000:3.0:1789601382.360184:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 202 00000100:00100000:0.0:1789601382.360184:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:3.0:1789601382.360193:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2356:x1876532858462720:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601382.360193:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858462848:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601382.360265:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2356:x1876532858462720:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 73us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601382.360282:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 202 00000100:00100000:0.0:1789601382.364334:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8311880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858462848:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 4128us (4286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601382.364350:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00080000:0.0:1789601382.364394:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789601382.409057:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601383.433521:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601384.396056:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601384.396079:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880516736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601384.396148:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601384.396207:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880516736 00000100:00100000:1.0:1789601384.396215:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880516736 00000100:00100000:1.0:1789601384.396280:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789601384.396289:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880516736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601384.396324:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601384.396377:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880516736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601384.396384:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1789601384.396411:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789601384.396564:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00a58700 x1876532880516736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601384.396584:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880516736:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789601384.460539:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601385.491883:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601386.442025:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880516864:0@lo:400:kworker.0 00000100:00100000:0.0:1789601386.442105:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601386.442177:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880517376:0@lo:400:kworker.0 00000100:00100000:0.0:1789601386.442214:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601386.442240:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789601386.442245:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880516992:0@lo:400:kworker.0 00000100:00100000:0.0:1789601386.442266:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601386.442296:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880517504:0@lo:400:kworker.0 00000100:00100000:0.0:1789601386.442320:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601386.442348:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880517120:0@lo:400:kworker.0 00000100:00100000:0.0:1789601386.442369:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601386.442385:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789601386.442390:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880517248:0@lo:400:kworker.0 00000100:00100000:0.0:1789601386.442406:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601386.442434:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880517376 00000100:00100000:0.0:1789601386.442442:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880517376 00000100:00100000:0.0:1789601386.442494:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880516992 00000100:00100000:0.0:1789601386.442508:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880516992 00000100:00100000:0.0:1789601386.442522:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880517120 00000100:00100000:0.0:1789601386.442523:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880517120 00000100:00100000:0.0:1789601386.442537:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789601386.442544:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880517376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601386.442593:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880517376:12345-0@lo:400:kworker.0 Request processed in 49us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601386.442599:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789601386.442615:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789601386.442620:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880516992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601386.442641:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880516992:12345-0@lo:400:kworker.0 Request processed in 21us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601386.442646:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789601386.442655:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789601386.442659:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880517120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601386.442681:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880517120:12345-0@lo:400:kworker.0 Request processed in 22us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601386.442695:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789601386.442714:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880517504 00000100:00100000:0.0:1789601386.442717:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880517504 00000100:00100000:0.0:1789601386.442739:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880517248 00000100:00100000:0.0:1789601386.442741:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880517248 00000100:00100000:0.0:1789601386.442753:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789601386.442758:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880517504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601386.442785:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880517504:12345-0@lo:400:kworker.0 Request processed in 27us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601386.442790:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789601386.442799:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789601386.442804:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880517248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601386.442823:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880517248:12345-0@lo:400:kworker.0 Request processed in 19us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601386.442828:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1789601386.442865:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789601386.442870:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601386.442873:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789601386.442912:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee002ad180 x1876532880517248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601386.442925:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880517248:0@lo:400:kworker.0 00000100:00100000:0.0:1789601386.442935:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880517120:0@lo:400:kworker.0 00000100:00100000:0.0:1789601386.442960:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880516992:0@lo:400:kworker.0 00010000:00080000:0.0:1789601386.442969:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee002ac000 x1876532880517504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601386.442988:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880517504:0@lo:400:kworker.0 00000100:00100000:0.0:1789601386.442998:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880517376:0@lo:400:kworker.0 00000100:00100000:2.0:1789601386.443390:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880516864 00000100:00100000:2.0:1789601386.443395:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880516864 00000100:00100000:2.0:1789601386.443426:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789601386.443432:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880516864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601386.443475:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880516864:12345-0@lo:400:kworker.0 Request processed in 44us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601386.443488:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789601386.443556:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880516864:0@lo:400:kworker.0 00010000:00010000:2.0:1789601386.508814:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601386.959019:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880517632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601386.959119:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601386.959282:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880517632 00000100:00100000:2.0:1789601386.959292:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880517632 00000100:00100000:2.0:1789601386.959361:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789601386.959372:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880517632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601386.959411:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601386.959473:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880517632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601386.959481:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789601386.959677:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8fb80 x1876532880517632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601386.959698:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880517632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601387.486119:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601387.486173:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601387.486216:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858463104 00000100:00100000:1.0:1789601387.486226:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858463104 00000100:00100000:1.0:1789601387.486290:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:1.0:1789601387.486300:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2359:x1876532858463104:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789601387.486376:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2359:x1876532858463104:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 78us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601387.486383:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00080000:1.0:1789601387.486406:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601387.488323:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858462976 00000100:00100000:2.0:1789601387.488337:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858462976 00000100:00100000:2.0:1789601387.488396:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 204 00000100:00100000:2.0:1789601387.488406:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2359:x1876532858462976:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601387.488478:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2359:x1876532858462976:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 73us (2369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601387.488486:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 204 00010000:00010000:0.0:1789601387.531193:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601388.558157:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601389.516832:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601389.516882:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880517760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601389.516959:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601389.517109:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880517760 00000100:00100000:1.0:1789601389.517118:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880517760 00000100:00100000:1.0:1789601389.517203:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789601389.517213:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8310700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880517760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601389.517257:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601389.517309:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8310700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880517760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601389.517315:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789601389.517354:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00a59f80 x1876532880517760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601389.517371:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880517760:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789601389.517671:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789601389.582308:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601390.601116:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601391.561224:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880518016:0@lo:400:kworker.0 00000100:00100000:0.0:1789601391.561308:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601391.561336:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880518272:0@lo:400:kworker.0 00000100:00100000:1.0:1789601391.561374:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601391.561432:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601391.561438:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880518144:0@lo:400:kworker.0 00000100:00100000:1.0:1789601391.561463:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601391.561501:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880518528:0@lo:400:kworker.0 00000100:00100000:0.0:1789601391.561529:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880518272 00000100:00100000:0.0:1789601391.561540:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880518272 00000100:00100000:1.0:1789601391.561541:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601391.561572:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789601391.561579:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880517888:0@lo:400:kworker.0 00000100:00100000:0.0:1789601391.561600:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880518528 00000100:00100000:0.0:1789601391.561604:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880518528 00000100:00100000:1.0:1789601391.561614:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601391.561629:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789601391.561640:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880518272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601391.561653:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880518400:0@lo:400:kworker.0 00000100:00100000:2.0:1789601391.561863:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880518016 00000100:00100000:2.0:1789601391.561868:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880518016 00000100:00100000:0.0:1789601391.561875:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880518272:12345-0@lo:400:kworker.0 Request processed in 236us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601391.561885:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789601391.561904:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880518144 00000100:00100000:2.0:1789601391.561909:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880518144 00000100:00100000:0.0:1789601391.561909:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789601391.561920:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880518528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601391.561940:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789601391.561950:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880518016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601391.561960:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880518528:12345-0@lo:400:kworker.0 Request processed in 40us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601391.561968:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1789601391.561992:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789601391.561999:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601391.562001:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880518016:12345-0@lo:400:kworker.0 Request processed in 52us (694us total) trans 0 rc 0/0 00000100:00080000:0.0:1789601391.562002:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601391.562011:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789601391.562015:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880517888 00000100:00100000:0.0:1789601391.562020:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880517888 00000100:00100000:2.0:1789601391.562028:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789601391.562037:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880518144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601391.562051:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789601391.562066:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880518144:12345-0@lo:400:kworker.0 Request processed in 31us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601391.562072:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789601391.562146:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3318:x1876532880517888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601391.562214:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880518144:0@lo:400:kworker.0 00010000:00080000:2.0:1789601391.562227:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee002af480 x1876532880518272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601391.562237:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880518272:0@lo:400:kworker.0 00000100:00100000:0.0:1789601391.563755:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3318:x1876532880517888:12345-0@lo:400:kworker.0 Request processed in 1680us (2134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601391.564375:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789601391.565422:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601391.565508:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880518016:0@lo:400:kworker.0 00010000:00080000:1.0:1789601391.565525:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee002aed80 x1876532880518528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601391.565534:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880518528:0@lo:400:kworker.0 00000100:00100000:1.0:1789601391.565559:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880517888:0@lo:400:kworker.0 00000100:00100000:2.0:1789601391.565660:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880518400 00000100:00100000:2.0:1789601391.565668:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880518400 00000100:00100000:2.0:1789601391.565751:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789601391.565761:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880518400:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789601391.565773:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601391.566370:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880518400:12345-0@lo:400:kworker.0 Request processed in 610us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601391.566378:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789601391.566458:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880518400:0@lo:400:kworker.0 00010000:00010000:2.0:1789601391.625680:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601392.081242:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880518656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601392.081318:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601392.081392:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880518656 00000100:00100000:2.0:1789601392.081401:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880518656 00000100:00100000:2.0:1789601392.081452:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789601392.081461:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880518656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601392.081494:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601392.081565:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880518656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601392.081572:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789601392.081652:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee002aea00 x1876532880518656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601392.081680:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880518656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601392.598202:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601392.598265:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601392.598301:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858463360 00000100:00100000:3.0:1789601392.598311:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858463360 00000100:00100000:2.0:1789601392.598523:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858463232 00000100:00100000:2.0:1789601392.598528:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858463232 00000100:00100000:2.0:1789601392.598558:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 206 00000100:00100000:2.0:1789601392.598567:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2357:x1876532858463232:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601392.598664:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2357:x1876532858463232:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 97us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601392.598673:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 206 00000100:00080000:2.0:1789601392.598728:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601392.598765:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:3.0:1789601392.598775:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858463360:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601392.598807:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8310a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858463360:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 35us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601392.615816:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00010000:00010000:0.0:1789601392.657959:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789601393.458185:0:10103:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 19:29:53 (1789601393) === 00010000:00010000:2.0:1789601393.675037:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601394.001750:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601394.001938:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858463488 00000100:00100000:0.0:1789601394.001954:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858463488 00000100:00100000:0.0:1789601394.002036:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 207 00000100:00100000:0.0:1789601394.002049:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:8129:x1876532858463488:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789601394.002081:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601394.002105:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc0031400/0xf3d6e402158abfcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f5060f78 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.002145:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc0031400/0xf3d6e402158abfcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f78 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.002159:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc0031400/0xf3d6e402158abfcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f78 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.002170:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc0031400, rc 0) 00000100:00100000:0.0:1789601394.002392:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+11:8129:x1876532858463488:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 344us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.002401:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 207 00000100:00100000:3.0:1789601394.008573:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601394.008705:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858463616 00000100:00100000:2.0:1789601394.008719:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858463616 00000100:00100000:2.0:1789601394.008809:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 208 00000100:00100000:2.0:1789601394.008821:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+11:8129:x1876532858463616:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789601394.009283:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+11:8129:x1876532858463616:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 461us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601394.009292:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 208 00000100:00100000:2.0:1789601394.023866:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601394.024056:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858463744 00000100:00100000:0.0:1789601394.024082:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858463744 00000100:00100000:0.0:1789601394.024151:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 209 00000100:00100000:0.0:1789601394.024162:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+11:8129:x1876532858463744:12345-192.168.201.30@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789601394.024481:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+11:8129:x1876532858463744:12345-192.168.201.30@tcp:503:mount.lustre.0 Request processed in 320us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.024490:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 209 00000100:00100000:3.0:1789601394.032310:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601394.032487:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858463872 00000100:00100000:1.0:1789601394.032512:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858463872 00000100:00100000:1.0:1789601394.032583:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 210 00000100:00100000:1.0:1789601394.032595:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+11:8133:x1876532858463872:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789601394.033009:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+11:8133:x1876532858463872:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 415us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.033025:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 210 00000100:00100000:3.0:1789601394.077081:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601394.077233:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858464000 00000100:00100000:2.0:1789601394.077246:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858464000 00000100:00100000:2.0:1789601394.077320:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 211 00000100:00100000:2.0:1789601394.077332:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+11:8133:x1876532858464000:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789601394.077710:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+11:8133:x1876532858464000:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 379us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601394.077727:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 211 00000100:00100000:2.0:1789601394.080786:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601394.080930:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858464128 00000100:00100000:0.0:1789601394.080943:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858464128 00000100:00100000:0.0:1789601394.081016:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 212 00000100:00100000:0.0:1789601394.081028:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+11:8129:x1876532858464128:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789601394.081049:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601394.081084:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abfd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f5060fa2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.081122:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abfd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fa2 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.081134:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abfd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fa2 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.081145:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc0030a00, rc 0) 00000100:00100000:0.0:1789601394.081232:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:8129:x1876532858464128:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 206us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.081239:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 212 00000100:00100000:3.0:1789601394.085745:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601394.085948:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858464256 00000100:00100000:1.0:1789601394.085962:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858464256 00000100:00100000:1.0:1789601394.086035:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 213 00000100:00100000:1.0:1789601394.086048:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:8129:x1876532858464256:12345-192.168.201.30@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789601394.086091:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789601394.086125:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789601394.086130:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789601394.086134:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789601394.086137:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789601394.088939:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:8129:x1876532858464256:12345-192.168.201.30@tcp:256:mount.lustre.0 Request processed in 2877us (3193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.088958:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 213 00000100:00100000:2.0:1789601394.093244:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601394.093377:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858464384 00000100:00100000:0.0:1789601394.093403:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858464384 00000100:00100000:0.0:1789601394.093475:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 214 00000100:00100000:0.0:1789601394.093487:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:8129:x1876532858464384:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789601394.093510:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601394.093546:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc0030600/0xf3d6e402158abfdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f5060fa9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.093585:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc0030600/0xf3d6e402158abfdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fa9 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.093597:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc0030600/0xf3d6e402158abfdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fa9 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601394.093607:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc0030600, rc 0) 00000100:00100000:0.0:1789601394.093683:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:8129:x1876532858464384:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 198us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.093690:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 214 00000100:00100000:3.0:1789601394.096009:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601394.096355:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858464512 00000100:00100000:1.0:1789601394.096372:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858464512 00000100:00100000:1.0:1789601394.096453:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 215 00000100:00100000:1.0:1789601394.096465:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:8129:x1876532858464512:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789601394.096958:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:8129:x1876532858464512:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 493us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.096966:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 215 00000100:00100000:3.0:1789601394.099763:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601394.099989:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858464640 00000100:00100000:2.0:1789601394.100002:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858464640 00000100:00100000:2.0:1789601394.100143:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 216 00000100:00100000:2.0:1789601394.100157:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:8129:x1876532858464640:12345-192.168.201.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789601394.100495:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:8129:x1876532858464640:12345-192.168.201.30@tcp:503:mount.lustre.0 Request processed in 340us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601394.100505:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 216 00000100:00100000:3.0:1789601394.103926:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601394.104907:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858464768 00000100:00100000:1.0:1789601394.104924:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858464768 00000100:00100000:1.0:1789601394.104991:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 217 00000100:00100000:1.0:1789601394.105003:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:8137:x1876532858464768:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789601394.105370:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:8137:x1876532858464768:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 368us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.105387:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 217 00000100:00100000:3.0:1789601394.107632:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601394.110323:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858464896 00000100:00100000:1.0:1789601394.110349:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858464896 00000100:00100000:1.0:1789601394.110427:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 218 00000100:00100000:1.0:1789601394.110441:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:8137:x1876532858464896:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789601394.110907:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:8137:x1876532858464896:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 468us (3288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.110915:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 218 00000100:00100000:3.0:1789601394.118591:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601394.118633:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601394.118735:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858465024 00000100:00100000:2.0:1789601394.118749:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858465024 00000100:00100000:2.0:1789601394.118790:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858465408 00000100:00100000:2.0:1789601394.118793:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858465408 00000100:00100000:2.0:1789601394.118859:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:2.0:1789601394.118872:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858465408:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:0.0:1789601394.119356:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601394.119380:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1789601394.119387:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2355:x1876532858465024:12345-192.168.201.30@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789601394.119434:0:5837:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 85db4f7d-704a-4080-a137-b2930e072a8c@192.168.201.30@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:0.0:1789601394.119483:0:5837:0:(genops.c:1384:class_connect()) connect: client 85db4f7d-704a-4080-a137-b2930e072a8c, cookie 0xf3d6e402158abfe2 00000004:00100000:0.0:1789601394.119524:0:5837:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789601394.119894:0:5837:0:(import.c:65:import_set_state_nolock()) ffff91ee002a3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789601394.124824:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9dabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858465408:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 5933us (6167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601394.124857:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:0.0:1789601394.125037:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9da8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85db4f7d-704a-4080-a137-b2930e072a8c+6:2355:x1876532858465024:12345-192.168.201.30@tcp:38:mount.lustre.0 Request processed in 5646us (6460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.125047:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:3.0:1789601394.130670:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601394.130771:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601394.137947:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858465152 00000100:00100000:0.0:1789601394.137970:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858465152 00000100:00100000:0.0:1789601394.138137:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858465280 00000100:00100000:0.0:1789601394.138143:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858465280 00000100:00100000:0.0:1789601394.138191:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1789601394.138228:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+7:0:x1876532858465152:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789601394.138295:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789601394.138438:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9dab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+7:0:x1876532858465152:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 215us (7785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.138446:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1789601394.138468:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1789601394.138476:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+6:8129:x1876532858465280:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789601394.138487:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789601394.138511:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9dab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+6:8129:x1876532858465280:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 36us (7740us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.138517:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1789601394.142014:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601394.142110:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858465536 00000100:00100000:2.0:1789601394.142124:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858465536 00000100:00100000:2.0:1789601394.142205:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:2.0:1789601394.142218:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+6:8129:x1876532858465536:12345-192.168.201.30@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789601394.142329:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+6:8129:x1876532858465536:12345-192.168.201.30@tcp:40:mount.lustre.0 Request processed in 114us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601394.142359:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:0.0:1789601394.144980:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601394.145028:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601394.145094:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601394.145149:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858465664 00000100:00100000:0.0:1789601394.145164:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858465664 00000100:00100000:0.0:1789601394.145222:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858465792 00000100:00100000:0.0:1789601394.145226:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858465792 00000100:00100000:0.0:1789601394.145242:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1789601394.145252:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1876532858465664:12345-192.168.201.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789601394.145296:0:6677:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 85db4f7d-704a-4080-a137-b2930e072a8c@192.168.201.30@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:0.0:1789601394.145340:0:6677:0:(genops.c:1384:class_connect()) connect: client 85db4f7d-704a-4080-a137-b2930e072a8c, cookie 0xf3d6e402158abfe9 00002000:00100000:0.0:1789601394.145355:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 85db4f7d-704a-4080-a137-b2930e072a8c/ffff91ee002a2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789601394.145387:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789601394.145811:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789601394.145901:0:6677:0:(import.c:65:import_set_state_nolock()) ffff91ee002a1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601394.145999:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85db4f7d-704a-4080-a137-b2930e072a8c+6:2355:x1876532858465664:12345-192.168.201.30@tcp:8:mount.lustre.0 Request processed in 746us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.146008:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1789601394.146037:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:0.0:1789601394.146043:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1876532858465792:12345-192.168.201.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789601394.146074:0:6677:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 85db4f7d-704a-4080-a137-b2930e072a8c@192.168.201.30@tcp t0 exp 0000000000000000 cur 264 last 0 00000020:00000080:0.0:1789601394.146094:0:6677:0:(genops.c:1384:class_connect()) connect: client 85db4f7d-704a-4080-a137-b2930e072a8c, cookie 0xf3d6e402158abff0 00002000:00100000:0.0:1789601394.146102:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 85db4f7d-704a-4080-a137-b2930e072a8c/ffff91ee002a6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789601394.146121:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789601394.146254:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789601394.146272:0:6677:0:(import.c:65:import_set_state_nolock()) ffff91ee002a0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601394.146298:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85db4f7d-704a-4080-a137-b2930e072a8c+6:2355:x1876532858465792:12345-192.168.201.30@tcp:8:mount.lustre.0 Request processed in 254us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601394.146304:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:3.0:1789601394.146866:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858465920 00000100:00100000:3.0:1789601394.146876:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858465920 00000100:00100000:3.0:1789601394.146936:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:3.0:1789601394.146946:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85db4f7d-704a-4080-a137-b2930e072a8c+6:8129:x1876532858465920:12345-192.168.201.30@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789601394.147031:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00080000:1.0:1789601394.147348:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601394.148940:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:85db4f7d-704a-4080-a137-b2930e072a8c+6:8129:x1876532858465920:12345-192.168.201.30@tcp:33:mount.lustre.0 Request processed in 1982us (3961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601394.148955:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:2.0:1789601394.634917:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880518784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601394.635027:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601394.635608:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880518784 00000100:00100000:1.0:1789601394.635621:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880518784 00000100:00100000:1.0:1789601394.635710:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789601394.635721:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880518784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601394.635751:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601394.635831:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880518784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601394.635866:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789601394.635938:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789601394.636132:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00a5aa00 x1876532880518784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601394.636154:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880518784:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789601394.697237:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601395.721126:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789601396.266399:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 85db4f7d-704a-4080-a137-b2930e072a8c 00000001:00100000:0.0:1789601396.321940:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 85db4f7d-704a-4080-a137-b2930e072a8c 00000100:00100000:0.0:1789601396.682815:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf9da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880518912:0@lo:400:kworker.0 00000100:00100000:3.0:1789601396.682878:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf9da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880519168:0@lo:400:kworker.0 00000100:00100000:1.0:1789601396.682988:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf9da8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880519040:0@lo:400:kworker.0 00000100:00100000:2.0:1789601396.683065:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf9da8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880519296:0@lo:400:kworker.0 00000100:00100000:0.0:1789601396.683228:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601396.683303:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf9dab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880519424:0@lo:400:kworker.0 00000100:00100000:0.0:1789601396.683348:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601396.683406:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880519424 00000100:00100000:0.0:1789601396.683417:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880519424 00000100:00100000:0.0:1789601396.683512:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789601396.683529:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880519424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601396.683619:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880519424:12345-0@lo:400:kworker.0 Request processed in 94us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601396.683629:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1789601396.683667:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601396.683713:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf9dab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880519424:0@lo:400:kworker.0 00000100:00100000:3.0:1789601396.686338:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601396.686463:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880519168 00000100:00100000:0.0:1789601396.686477:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880519168 00000100:00100000:0.0:1789601396.686578:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789601396.686593:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880519168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601396.686702:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9da9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880519168:12345-0@lo:400:kworker.0 Request processed in 114us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601396.686711:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789601396.686776:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf9da8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880519168:0@lo:400:kworker.0 00000100:00080000:3.0:1789601396.687256:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601396.688790:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880518912 00000100:00100000:0.0:1789601396.688807:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880518912 00000100:00100000:0.0:1789601396.688892:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789601396.688904:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880518912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601396.689052:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880518912:12345-0@lo:400:kworker.0 Request processed in 147us (5820us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601396.689063:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789601396.689174:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf9da9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880518912:0@lo:400:kworker.0 00000100:00100000:1.0:1789601396.690404:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601396.690895:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf9da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880519552:0@lo:400:kworker.0 00000100:00100000:1.0:1789601396.690951:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601396.691000:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880519552 00000100:00100000:1.0:1789601396.691009:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880519552 00000100:00100000:1.0:1789601396.691091:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789601396.691122:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880519552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601396.691189:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880519552:12345-0@lo:400:kworker.0 Request processed in 70us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601396.691197:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1789601396.691229:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789601396.691263:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf9da9f80 x1876532880519552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601396.692224:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880519040 00000100:00100000:3.0:1789601396.692236:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880519040 00000100:00100000:3.0:1789601396.692298:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789601396.692308:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880519040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601396.692388:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880519040:12345-0@lo:400:kworker.0 Request processed in 81us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601396.692423:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789601396.692596:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf9da9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880519552:0@lo:400:kworker.0 00000100:00100000:1.0:1789601396.692642:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf9da8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880519040:0@lo:400:kworker.0 00000100:00100000:2.0:1789601396.693701:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601396.693784:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880519296 00000100:00100000:3.0:1789601396.693792:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880519296 00000100:00100000:3.0:1789601396.693866:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789601396.693876:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880519296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601396.693944:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880519296:12345-0@lo:400:kworker.0 Request processed in 70us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601396.693950:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789601396.694745:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf9da8380 x1876532880519296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601396.694766:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf9da8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880519296:0@lo:400:kworker.0 00000100:00080000:1.0:1789601396.696030:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789601396.744989:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789601396.804514:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 85db4f7d-704a-4080-a137-b2930e072a8c 00000100:00100000:0.0:1789601397.197792:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880519680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601397.197925:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601397.200259:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880519680 00000100:00100000:1.0:1789601397.200279:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880519680 00000100:00100000:1.0:1789601397.200366:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789601397.200375:0:6680:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1789601397.200378:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880519680:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601397.200388:0:6680:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1789601397.200447:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601397.200564:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880519680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 188us (2639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601397.200572:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1789601397.200633:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee002ac700 x1876532880519680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601397.200660:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880519680:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789601397.769921:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601398.794208:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601399.274018:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601399.274162:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601399.274204:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601399.274247:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601399.274304:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601399.274349:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858466560 00000100:00100000:0.0:1789601399.274362:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858466560 00000100:00100000:0.0:1789601399.274438:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858466432 00000100:00100000:0.0:1789601399.274442:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858466432 00000100:00100000:0.0:1789601399.274465:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:0.0:1789601399.274478:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858466560:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601399.274577:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858466560:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 102us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601399.274585:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:0.0:1789601399.274608:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:0.0:1789601399.274614:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858466432:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601399.274640:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858466432:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601399.274646:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:1.0:1789601399.274912:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858466304 00000100:00100000:1.0:1789601399.274930:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858466304 00000100:00100000:1.0:1789601399.274982:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858466176 00000100:00100000:1.0:1789601399.274986:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858466176 00000100:00100000:1.0:1789601399.275009:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:1.0:1789601399.275016:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858466304:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789601399.275055:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858466304:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 40us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601399.275061:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:1.0:1789601399.275077:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:1.0:1789601399.275082:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858466176:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789601399.275106:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858466176:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601399.275111:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00080000:1.0:1789601399.275129:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789601399.275134:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789601399.275136:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601399.283455:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858466048 00000100:00100000:2.0:1789601399.283480:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858466048 00000100:00100000:2.0:1789601399.283578:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 220 00000100:00100000:2.0:1789601399.283591:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2356:x1876532858466048:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601399.284382:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2356:x1876532858466048:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 788us (10374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601399.284395:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 220 00000100:00100000:2.0:1789601399.753195:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880519808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601399.753253:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601399.753361:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880519808 00000100:00100000:3.0:1789601399.753368:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880519808 00000100:00100000:3.0:1789601399.753413:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789601399.753419:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880519808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789601399.753451:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789601399.754429:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880519808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1005us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601399.754439:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1789601399.754469:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789601399.754533:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00a58a80 x1876532880519808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601399.754568:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880519808:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789601399.817607:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789601400.339719:0:10300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1789601400.841058:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601401.810982:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf9da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880520192:0@lo:400:kworker.0 00000100:00100000:2.0:1789601401.811092:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf9daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880520064:0@lo:400:kworker.0 00000100:00100000:2.0:1789601401.811185:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601401.811209:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf9daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880519936:0@lo:400:kworker.0 00000100:00100000:0.0:1789601401.811247:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601401.811283:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880520064 00000100:00100000:2.0:1789601401.811293:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880520064 00000100:00100000:2.0:1789601401.811345:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789601401.811354:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880520064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601401.811430:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880519936 00000100:00100000:0.0:1789601401.811435:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880519936 00000100:00100000:0.0:1789601401.811469:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789601401.811475:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880519936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601401.811521:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880519936:12345-0@lo:400:kworker.0 Request processed in 45us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601401.811529:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789601401.811628:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880520064:12345-0@lo:400:kworker.0 Request processed in 273us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601401.811636:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789601401.811688:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf9daad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880520064:0@lo:400:kworker.0 00000100:00100000:3.0:1789601401.811900:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601401.811946:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880520192 00000100:00100000:3.0:1789601401.811950:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880520192 00000100:00100000:3.0:1789601401.811984:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789601401.811990:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880520192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601401.812100:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9daaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880520192:12345-0@lo:400:kworker.0 Request processed in 110us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601401.812107:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1789601401.812134:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601401.812157:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf9da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880520192:0@lo:400:kworker.0 00000100:00100000:3.0:1789601401.812240:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601401.812248:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf9da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880520320:0@lo:400:kworker.0 00000100:00100000:3.0:1789601401.812274:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601401.812300:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880520320 00000100:00100000:3.0:1789601401.812303:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880520320 00000100:00100000:3.0:1789601401.812331:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789601401.812337:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9daa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880520320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601401.812368:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9daa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880520320:12345-0@lo:400:kworker.0 Request processed in 32us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601401.812374:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1789601401.812386:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789601401.812774:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf9da9c00 x1876532880520320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601401.812786:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf9da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880520320:0@lo:400:kworker.0 00000100:00100000:2.0:1789601401.812852:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789601401.815297:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf9da9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880520576:0@lo:400:kworker.0 00000100:00100000:2.0:1789601401.815428:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601401.815482:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf9da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880520448:0@lo:400:kworker.0 00000100:00100000:2.0:1789601401.815509:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601401.815553:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880520576 00000100:00100000:2.0:1789601401.815564:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880520576 00000100:00100000:2.0:1789601401.815629:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789601401.815639:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880520576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601401.815716:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf9daa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880519936:0@lo:400:kworker.0 00000100:00100000:3.0:1789601401.816958:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880520448 00000100:00100000:3.0:1789601401.816976:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880520448 00000100:00100000:3.0:1789601401.817056:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789601401.817067:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880520448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601401.817720:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880520576:12345-0@lo:400:kworker.0 Request processed in 2078us (2287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601401.817730:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1789601401.817775:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789601401.817781:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789601401.818187:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf9da9500 x1876532880520576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601401.818205:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf9da9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880520576:0@lo:400:kworker.0 00000100:00100000:3.0:1789601401.820438:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880520448:12345-0@lo:400:kworker.0 Request processed in 3363us (4917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601401.820457:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789601401.820670:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf9da9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880520448:0@lo:400:kworker.0 00010000:00010000:0.0:1789601401.866268:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601402.313242:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880520704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601402.313350:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601402.313519:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880520704 00000100:00100000:0.0:1789601402.313530:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880520704 00000100:00100000:0.0:1789601402.313601:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789601402.313613:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9da8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880520704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789601402.313672:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789601402.313742:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9da8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880520704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601402.313750:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1789601402.313931:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee002ac700 x1876532880520704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601402.313974:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880520704:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789601402.889083:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601403.914022:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601404.373047:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601404.373107:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601404.373152:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601404.373196:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601404.373225:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601404.373286:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858466816 00000100:00100000:3.0:1789601404.373299:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858466816 00000100:00100000:3.0:1789601404.373394:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858466944 00000100:00100000:3.0:1789601404.373397:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858466944 00000100:00100000:3.0:1789601404.373424:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00100000:3.0:1789601404.373436:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858466816:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601404.373537:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858466816:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 102us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601404.373545:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00100000:3.0:1789601404.373564:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:3.0:1789601404.373571:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858466944:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601404.373597:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858466944:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601404.373604:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00080000:0.0:1789601404.373872:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601404.373965:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858467072 00000100:00100000:2.0:1789601404.373972:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858467072 00000100:00100000:2.0:1789601404.374032:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858467200 00000100:00100000:2.0:1789601404.374035:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858467200 00000100:00100000:2.0:1789601404.374055:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:2.0:1789601404.374063:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefeb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858467072:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601404.374113:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefeb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858467072:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 52us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601404.374120:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00080000:0.0:1789601404.374481:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601404.374487:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601404.374536:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858466688 00000100:00100000:0.0:1789601404.374565:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858466688 00000100:00100000:0.0:1789601404.374616:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 222 00000100:00100000:0.0:1789601404.374624:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2356:x1876532858466688:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601404.374658:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2356:x1876532858466688:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 36us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601404.374665:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 222 00000100:00100000:0.0:1789601404.374714:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:0.0:1789601404.374723:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858467200:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601404.374754:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858467200:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 32us (1526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601404.374762:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:1.0:1789601404.876746:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880520832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601404.876822:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601404.876928:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880520832 00000100:00100000:1.0:1789601404.876937:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880520832 00000100:00100000:1.0:1789601404.877189:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789601404.877199:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880520832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601404.877238:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601404.877306:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880520832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601404.877313:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1789601404.877348:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789601404.877380:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00a58e00 x1876532880520832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601404.877399:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880520832:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789601404.937116:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601405.963130:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601406.926109:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880521088:0@lo:400:kworker.0 00000100:00100000:3.0:1789601406.926191:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601406.926261:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880521600:0@lo:400:kworker.0 00000100:00100000:3.0:1789601406.926286:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601406.926335:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789601406.926342:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880520960:0@lo:400:kworker.0 00000100:00100000:3.0:1789601406.926370:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601406.926390:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880521472:0@lo:400:kworker.0 00000100:00100000:3.0:1789601406.926433:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601406.926464:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880521600 00000100:00100000:3.0:1789601406.926471:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880521600 00000100:00100000:3.0:1789601406.926525:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789601406.926534:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9da9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880521600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601406.926583:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9da9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880521600:12345-0@lo:400:kworker.0 Request processed in 51us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601406.926590:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789601406.926612:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880520960 00000100:00100000:3.0:1789601406.926616:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880520960 00000100:00100000:3.0:1789601406.926639:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789601406.926645:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3318:x1876532880520960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601406.926674:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3318:x1876532880520960:12345-0@lo:400:kworker.0 Request processed in 28us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601406.926679:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789601406.926704:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880521088 00000100:00100000:3.0:1789601406.926707:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880521088 00000100:00100000:3.0:1789601406.926729:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880521472 00000100:00100000:3.0:1789601406.926732:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880521472 00000100:00100000:3.0:1789601406.926750:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789601406.926757:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880521088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601406.926784:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9daa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880521088:12345-0@lo:400:kworker.0 Request processed in 28us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601406.926790:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789601406.926816:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789601406.926823:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880521472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601406.926881:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9da9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880521472:12345-0@lo:400:kworker.0 Request processed in 59us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601406.926893:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1789601406.926911:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601406.926916:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601406.926947:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880520960:0@lo:400:kworker.0 00000100:00100000:3.0:1789601406.927091:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880521472:0@lo:400:kworker.0 00000100:00100000:3.0:1789601406.927103:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880521088:0@lo:400:kworker.0 00010000:00080000:3.0:1789601406.927114:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8c380 x1876532880521600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601406.927124:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880521600:0@lo:400:kworker.0 00000100:00100000:1.0:1789601406.928186:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880521216:0@lo:400:kworker.0 00000100:00100000:1.0:1789601406.928243:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601406.928292:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601406.928299:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880521344:0@lo:400:kworker.0 00000100:00100000:1.0:1789601406.928322:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601406.928409:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880521344 00000100:00100000:0.0:1789601406.928417:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880521344 00000100:00100000:0.0:1789601406.928469:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789601406.928481:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880521344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601406.928526:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880521344:12345-0@lo:400:kworker.0 Request processed in 50us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601406.928532:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789601406.928659:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880521216 00000100:00100000:2.0:1789601406.928664:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880521216 00000100:00100000:2.0:1789601406.928704:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789601406.928711:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880521216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601406.928752:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880521216:12345-0@lo:400:kworker.0 Request processed in 42us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601406.928758:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1789601406.928819:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789601406.928824:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789601406.928884:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8ed80 x1876532880521344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601406.928897:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880521344:0@lo:400:kworker.0 00000100:00100000:1.0:1789601406.928905:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880521216:0@lo:400:kworker.0 00010000:00010000:1.0:1789601406.985021:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601407.442098:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789601407.442120:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880521728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601407.442202:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601407.442372:0:10225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880521728 00000100:00100000:0.0:1789601407.442382:0:10225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880521728 00000100:00100000:0.0:1789601407.442454:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789601407.442464:0:10225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9daa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880521728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789601407.442503:0:10225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789601407.442556:0:10225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9daa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880521728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601407.442580:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1789601407.442622:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf8b1b100 x1876532880521728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601407.442640:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880521728:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789601408.010094:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601409.033430:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601409.501290:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601409.501336:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601409.501365:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601409.501386:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601409.501408:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601409.501439:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858467584 00000100:00100000:0.0:1789601409.501450:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858467584 00000100:00100000:0.0:1789601409.501527:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858467456 00000100:00100000:0.0:1789601409.501532:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858467456 00000100:00100000:0.0:1789601409.501558:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:0.0:1789601409.501567:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858467584:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601409.501655:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858467584:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 78us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601409.501662:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:0.0:1789601409.501680:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:0.0:1789601409.501687:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858467456:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601409.501711:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858467456:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601409.501717:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:0.0:1789601409.501735:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858467840 00000100:00100000:0.0:1789601409.501750:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858467840 00000100:00100000:0.0:1789601409.501778:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858467712 00000100:00100000:0.0:1789601409.501780:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858467712 00000100:00100000:0.0:1789601409.501809:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:0.0:1789601409.501816:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858467840:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601409.501858:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858467840:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 43us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601409.501865:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:0.0:1789601409.501876:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:0.0:1789601409.501882:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85db4f7d-704a-4080-a137-b2930e072a8c+5:2357:x1876532858467712:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601409.502187:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85db4f7d-704a-4080-a137-b2930e072a8c+5:2357:x1876532858467712:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 304us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601409.502195:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00080000:0.0:1789601409.502349:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789601409.502354:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601409.502356:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601409.503831:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858467328 00000100:00100000:3.0:1789601409.503862:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858467328 00000100:00100000:3.0:1789601409.503915:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 224 00000100:00100000:3.0:1789601409.503924:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2356:x1876532858467328:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601409.503986:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2356:x1876532858467328:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 63us (2706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601409.503993:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 224 00000100:00100000:2.0:1789601410.005261:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880521856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601410.005329:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601410.005448:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880521856 00000100:00100000:1.0:1789601410.005456:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880521856 00000100:00100000:1.0:1789601410.005517:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789601410.005527:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880521856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601410.005561:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601410.005611:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880521856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601410.005618:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1789601410.005664:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8d880 x1876532880521856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601410.005683:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880521856:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789601410.007889:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789601410.058093:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601411.083060:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601412.041677:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880522240:0@lo:400:kworker.0 00000100:00100000:1.0:1789601412.041802:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601412.041928:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601412.041936:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880522368:0@lo:400:kworker.0 00000100:00100000:1.0:1789601412.041970:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601412.042021:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880522240 00000100:00100000:1.0:1789601412.042032:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880522240 00000100:00100000:1.0:1789601412.042121:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789601412.042134:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880522240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601412.042548:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880522112:0@lo:400:kworker.0 00000100:00100000:3.0:1789601412.042593:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601412.042619:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880522624:0@lo:400:kworker.0 00000100:00100000:3.0:1789601412.042642:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601412.042688:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789601412.042694:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880521984:0@lo:400:kworker.0 00000100:00100000:3.0:1789601412.042724:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601412.042769:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880522496:0@lo:400:kworker.0 00000100:00100000:3.0:1789601412.042794:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601412.044044:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880522240:12345-0@lo:400:kworker.0 Request processed in 1902us (2231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601412.044062:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789601412.044102:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880522112 00000100:00100000:1.0:1789601412.044113:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880522112 00000100:00100000:1.0:1789601412.044146:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880522496 00000100:00100000:1.0:1789601412.044149:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880522496 00000100:00100000:1.0:1789601412.044436:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789601412.044445:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9daad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880522112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601412.044520:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9daad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880522112:12345-0@lo:400:kworker.0 Request processed in 76us (1926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601412.044526:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789601412.044553:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789601412.044560:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9da8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880522496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601412.044609:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9da8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880522496:12345-0@lo:400:kworker.0 Request processed in 50us (1814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601412.044616:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789601412.044647:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880522368 00000100:00100000:1.0:1789601412.044652:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880522368 00000100:00100000:1.0:1789601412.044686:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880522624 00000100:00100000:1.0:1789601412.044689:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880522624 00000100:00100000:1.0:1789601412.044707:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789601412.044714:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880522368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601412.044765:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880522368:12345-0@lo:400:kworker.0 Request processed in 51us (2795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601412.044773:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789601412.044784:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789601412.044791:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880522624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601412.044824:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9da8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880522624:12345-0@lo:400:kworker.0 Request processed in 35us (2181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601412.044830:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1789601412.044886:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601412.044892:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789601412.044895:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789601412.044950:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00a5aa00 x1876532880522368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601412.044970:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880522368:0@lo:400:kworker.0 00000100:00100000:1.0:1789601412.044987:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880522240:0@lo:400:kworker.0 00000100:00100000:1.0:1789601412.045126:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880521984 00000100:00100000:1.0:1789601412.045132:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880521984 00000100:00100000:2.0:1789601412.045915:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880522496:0@lo:400:kworker.0 00000100:00100000:2.0:1789601412.045936:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880522112:0@lo:400:kworker.0 00010000:00080000:2.0:1789601412.045956:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00a3ed80 x1876532880522624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601412.045969:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880522624:0@lo:400:kworker.0 00000100:00100000:1.0:1789601412.047459:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789601412.047499:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3318:x1876532880521984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601412.047654:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3318:x1876532880521984:12345-0@lo:400:kworker.0 Request processed in 177us (4928us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601412.049083:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880521984:0@lo:400:kworker.0 00000100:00100000:1.0:1789601412.056723:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00010000:00010000:0.0:1789601412.105033:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601412.553290:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789601412.553340:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880522752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601412.553422:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601412.553560:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880522752 00000100:00100000:0.0:1789601412.553569:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880522752 00000100:00100000:0.0:1789601412.553628:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789601412.553638:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880522752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789601412.553690:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789601412.553763:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880522752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601412.553770:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1789601412.553819:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf8b1ad80 x1876532880522752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601412.553864:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880522752:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789601413.131318:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601414.157157:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601414.619226:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601414.619291:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601414.619317:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601414.619339:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601414.619364:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601414.619394:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858467968 00000100:00100000:3.0:1789601414.619404:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858467968 00000100:00100000:3.0:1789601414.619457:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 226 00000100:00100000:3.0:1789601414.619468:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2358:x1876532858467968:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601414.619539:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2358:x1876532858467968:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 73us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601414.619546:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 226 00000100:00100000:3.0:1789601414.619579:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858468224 00000100:00100000:3.0:1789601414.619583:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858468224 00000100:00100000:3.0:1789601414.619620:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858468096 00000100:00100000:3.0:1789601414.619624:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858468096 00000100:00100000:3.0:1789601414.619648:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 85 00000100:00100000:3.0:1789601414.619654:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85db4f7d-704a-4080-a137-b2930e072a8c+5:2358:x1876532858468224:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601414.619685:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9da9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85db4f7d-704a-4080-a137-b2930e072a8c+5:2358:x1876532858468224:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 30us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601414.619721:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 85 00000100:00100000:3.0:1789601414.619737:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:3.0:1789601414.619743:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2358:x1876532858468096:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601414.619781:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9da9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2358:x1876532858468096:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601414.619787:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:3.0:1789601414.619810:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858468352 00000100:00100000:3.0:1789601414.619814:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858468352 00000100:00100000:3.0:1789601414.619879:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858468480 00000100:00100000:3.0:1789601414.619883:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858468480 00000100:00100000:3.0:1789601414.619901:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:3.0:1789601414.619907:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9da8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85db4f7d-704a-4080-a137-b2930e072a8c+5:2355:x1876532858468352:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:3.0:1789601414.619927:0:6677:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abfe9 00000100:00080000:3.0:1789601414.619936:0:6677:0:(import.c:65:import_set_state_nolock()) ffff91ee002a1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789601414.619977:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789601414.620298:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9da8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85db4f7d-704a-4080-a137-b2930e072a8c+2:2355:x1876532858468352:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 390us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601414.620305:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:3.0:1789601414.620318:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:3.0:1789601414.620324:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85db4f7d-704a-4080-a137-b2930e072a8c+5:2355:x1876532858468480:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:3.0:1789601414.620335:0:6677:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abff0 00000100:00080000:3.0:1789601414.620340:0:6677:0:(import.c:65:import_set_state_nolock()) ffff91ee002a0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789601414.620362:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789601414.620545:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:85db4f7d-704a-4080-a137-b2930e072a8c+2:2355:x1876532858468480:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 220us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601414.620563:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00080000:3.0:1789601414.620730:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601414.620735:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789601414.620737:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789601414.620757:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601414.620763:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601415.113144:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880522880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601415.113217:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601415.113339:0:10225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880522880 00000100:00100000:2.0:1789601415.113348:0:10225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880522880 00000100:00080000:3.0:1789601415.113416:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601415.113417:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789601415.113427:0:10225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880522880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601415.113463:0:10225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601415.113526:0:10225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880522880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601415.113533:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1789601415.113554:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8c380 x1876532880522880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601415.113573:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880522880:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789601415.178970:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601416.202224:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789601416.712363:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 85db4f7d-704a-4080-a137-b2930e072a8c 00000020:00000080:0.0:1789601416.712373:0:6703:0:(genops.c:885:class_export_put()) final put ffff91ee002a2000/85db4f7d-704a-4080-a137-b2930e072a8c 00000020:00000080:0.0:1789601416.712406:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91ee002a2000/85db4f7d-704a-4080-a137-b2930e072a8c for lustre-OST0000 00000020:00000080:0.0:1789601416.713324:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91ee002a1000 for lustre-OST0000 00000100:00100000:0.0:1789601417.161210:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880523264:0@lo:400:kworker.0 00000100:00100000:0.0:1789601417.161281:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601417.161341:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789601417.161347:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880523392:0@lo:400:kworker.0 00000100:00100000:0.0:1789601417.161374:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601417.161413:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880523264 00000100:00100000:1.0:1789601417.161641:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880523136:0@lo:400:kworker.0 00000100:00100000:1.0:1789601417.161682:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601417.161704:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880523648:0@lo:400:kworker.0 00000100:00100000:1.0:1789601417.161724:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601417.161747:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789601417.161753:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880523008:0@lo:400:kworker.0 00000100:00100000:1.0:1789601417.161786:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601417.161806:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880523520:0@lo:400:kworker.0 00000100:00100000:1.0:1789601417.161826:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601417.161878:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880523136 00000100:00100000:1.0:1789601417.161886:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880523136 00000100:00100000:1.0:1789601417.161929:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880523520 00000100:00100000:1.0:1789601417.161932:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880523520 00000100:00100000:1.0:1789601417.161958:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789601417.161966:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880523136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601417.162138:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880523136:12345-0@lo:400:kworker.0 Request processed in 172us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601417.162145:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789601417.162161:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789601417.162180:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880523520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601417.162209:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880523520:12345-0@lo:400:kworker.0 Request processed in 31us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601417.162214:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789601417.162233:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880523392 00000100:00100000:1.0:1789601417.162236:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880523392 00000100:00100000:1.0:1789601417.162261:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880523648 00000100:00100000:1.0:1789601417.162264:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880523648 00000100:00100000:1.0:1789601417.162277:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789601417.162283:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880523392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601417.162317:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880523392:12345-0@lo:400:kworker.0 Request processed in 35us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601417.162323:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789601417.162334:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789601417.162339:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880523648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601417.162366:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880523648:12345-0@lo:400:kworker.0 Request processed in 26us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601417.162371:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789601417.162388:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880523008 00000100:00100000:1.0:1789601417.162391:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880523008 00000100:00100000:1.0:1789601417.162413:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789601417.162419:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3318:x1876532880523008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601417.162445:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3318:x1876532880523008:12345-0@lo:400:kworker.0 Request processed in 26us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601417.162451:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:1.0:1789601417.162481:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601417.162485:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789601417.162495:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601417.162530:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880523008:0@lo:400:kworker.0 00000100:00100000:1.0:1789601417.162543:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880523520:0@lo:400:kworker.0 00000100:00100000:1.0:1789601417.162551:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880523136:0@lo:400:kworker.0 00010000:00080000:1.0:1789601417.162563:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf8b1bb80 x1876532880523648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601417.162573:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880523648:0@lo:400:kworker.0 00010000:00080000:1.0:1789601417.166878:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf8b18a80 x1876532880523392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601417.166898:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880523392:0@lo:400:kworker.0 00000100:00100000:0.0:1789601417.168095:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880523264 00000100:00080000:0.0:1789601417.168134:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601417.168193:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789601417.168204:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880523264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601417.168303:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880523264:12345-0@lo:400:kworker.0 Request processed in 101us (7022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601417.168311:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789601417.170247:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880523264:0@lo:400:kworker.0 00010000:00010000:1.0:1789601417.232109:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789601417.302640:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 85db4f7d-704a-4080-a137-b2930e072a8c 00000020:00000080:1.0:1789601417.302659:0:7635:0:(genops.c:885:class_export_put()) final put ffff91ee002a6000/85db4f7d-704a-4080-a137-b2930e072a8c 00000020:00000080:1.0:1789601417.302696:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ee002a6000/85db4f7d-704a-4080-a137-b2930e072a8c for lustre-OST0001 00000020:00000080:1.0:1789601417.302738:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91ee002a0800 for lustre-OST0001 00000100:00100000:2.0:1789601417.678806:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601417.678826:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880523776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601417.678911:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601417.678983:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880523776 00000100:00100000:2.0:1789601417.678990:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880523776 00000100:00100000:2.0:1789601417.679033:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789601417.679040:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880523776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601417.679069:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601417.679104:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880523776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601417.679108:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1789601417.679143:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8f480 x1876532880523776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601417.679155:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880523776:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789601418.249097:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601419.273046:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601419.738966:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601419.739261:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601419.739298:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601419.741429:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858468864 00000100:00100000:1.0:1789601419.741449:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858468864 00000100:00100000:1.0:1789601419.741553:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858468736 00000100:00100000:1.0:1789601419.741556:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858468736 00000100:00100000:1.0:1789601419.741591:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 90 00000100:00100000:1.0:1789601419.741613:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+5:2359:x1876532858468864:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789601419.741724:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+5:2359:x1876532858468864:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 124us (2464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601419.741747:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 90 00000100:00100000:1.0:1789601419.741768:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 91 00000100:00100000:1.0:1789601419.741774:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2359:x1876532858468736:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789601419.741796:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2359:x1876532858468736:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (2498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601419.741802:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 91 00000100:00080000:3.0:1789601419.744151:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601419.753948:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858468608 00000100:00100000:2.0:1789601419.753994:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858468608 00000100:00100000:3.0:1789601419.754240:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 228 00000100:00100000:3.0:1789601419.754254:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2359:x1876532858468608:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601419.754344:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2359:x1876532858468608:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 92us (15388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601419.754356:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 228 00000100:00100000:3.0:1789601420.254895:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880523904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601420.255015:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601420.255490:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880523904 00000100:00100000:2.0:1789601420.255502:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880523904 00000100:00100000:2.0:1789601420.255590:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789601420.255612:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880523904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601420.255659:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601420.255745:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880523904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601420.255754:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1789601420.259412:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789601420.259500:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8f480 x1876532880523904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601420.259531:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880523904:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789601420.312428:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789601420.527639:0:11004:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789601421.321031:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601422.288746:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880524288:0@lo:400:kworker.0 00000100:00100000:3.0:1789601422.288860:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601422.288929:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601422.288935:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880524416:0@lo:400:kworker.0 00000100:00100000:3.0:1789601422.288962:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601422.291699:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880524160:0@lo:400:kworker.0 00000100:00100000:1.0:1789601422.291792:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601422.291858:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880524672:0@lo:400:kworker.0 00000100:00100000:1.0:1789601422.291886:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601422.291915:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789601422.291923:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880524032:0@lo:400:kworker.0 00000100:00100000:1.0:1789601422.291962:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601422.291992:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880524544:0@lo:400:kworker.0 00000100:00100000:1.0:1789601422.292013:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601422.292045:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880524288 00000100:00100000:1.0:1789601422.292055:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880524288 00000100:00100000:1.0:1789601422.292119:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880524160 00000100:00100000:1.0:1789601422.292123:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880524160 00000100:00100000:1.0:1789601422.292139:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880524544 00000100:00100000:1.0:1789601422.292142:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880524544 00000100:00100000:1.0:1789601422.292160:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789601422.292168:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880524288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601422.292237:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880524288:12345-0@lo:400:kworker.0 Request processed in 69us (3377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601422.292262:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789601422.292281:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789601422.292287:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880524160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601422.292324:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880524160:12345-0@lo:400:kworker.0 Request processed in 37us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601422.292329:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789601422.292340:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789601422.292345:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880524544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601422.292368:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880524544:12345-0@lo:400:kworker.0 Request processed in 23us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601422.292373:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789601422.292390:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880524416 00000100:00100000:1.0:1789601422.292394:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880524416 00000100:00100000:1.0:1789601422.292419:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880524672 00000100:00100000:1.0:1789601422.292422:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880524672 00000100:00100000:1.0:1789601422.292437:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789601422.292444:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880524416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601422.292477:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880524416:12345-0@lo:400:kworker.0 Request processed in 35us (3514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601422.292484:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789601422.292494:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789601422.292499:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880524672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601422.292523:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880524672:12345-0@lo:400:kworker.0 Request processed in 24us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601422.292529:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789601422.292578:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880524032 00000100:00100000:1.0:1789601422.292581:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880524032 00000100:00100000:1.0:1789601422.292609:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789601422.292616:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3318:x1876532880524032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601422.292651:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3318:x1876532880524032:12345-0@lo:400:kworker.0 Request processed in 36us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601422.292657:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:1.0:1789601422.292686:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601422.292691:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789601422.292694:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789601422.292739:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf8b1c380 x1876532880524416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601422.292756:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880524416:0@lo:400:kworker.0 00000100:00100000:1.0:1789601422.292769:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880524288:0@lo:400:kworker.0 00000100:00100000:1.0:1789601422.292797:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880524032:0@lo:400:kworker.0 00000100:00100000:1.0:1789601422.292805:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880524544:0@lo:400:kworker.0 00000100:00100000:1.0:1789601422.292814:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880524160:0@lo:400:kworker.0 00010000:00080000:1.0:1789601422.292822:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf8b1df80 x1876532880524672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601422.292831:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880524672:0@lo:400:kworker.0 00010000:00010000:2.0:1789601422.345078:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601422.793312:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880524800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601422.793405:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601422.793528:0:10225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880524800 00000100:00100000:2.0:1789601422.793538:0:10225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880524800 00000100:00100000:2.0:1789601422.793615:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789601422.793627:0:10225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880524800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601422.793684:0:10225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601422.793754:0:10225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880524800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601422.793762:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1789601422.793812:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8d180 x1876532880524800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601422.793832:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880524800:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789601423.376020:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601424.401442:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601424.874441:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601424.874486:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601424.874541:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601424.874699:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858468992 00000100:00100000:3.0:1789601424.874713:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858468992 00000100:00100000:3.0:1789601424.874779:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 230 00000100:00100000:3.0:1789601424.874790:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2357:x1876532858468992:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601424.874915:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2357:x1876532858468992:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 126us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601424.874923:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 230 00000100:00100000:0.0:1789601424.876988:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858469248 00000100:00100000:0.0:1789601424.877004:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858469248 00000100:00100000:0.0:1789601424.877073:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858469120 00000100:00100000:0.0:1789601424.877076:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858469120 00000100:00100000:0.0:1789601424.877109:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 95 00000100:00100000:0.0:1789601424.877118:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+5:2357:x1876532858469248:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601424.877197:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+5:2357:x1876532858469248:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 80us (2709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601424.877203:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 95 00000100:00100000:0.0:1789601424.877219:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 96 00000100:00100000:0.0:1789601424.877225:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858469120:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601424.877245:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858469120:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 20us (2704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601424.877252:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 96 00000100:00080000:3.0:1789601424.877921:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601425.353742:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880524928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601425.353824:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601425.353967:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880524928 00000100:00100000:2.0:1789601425.353975:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880524928 00000100:00100000:2.0:1789601425.354043:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789601425.354053:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880524928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601425.354103:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601425.354156:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880524928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601425.354163:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1789601425.354607:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789601425.354650:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8d180 x1876532880524928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601425.354669:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880524928:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789601425.423090:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789601426.295210:0:11152:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec37168c0 20000000:00000080:2.0:1789601426.295233:0:11152:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91edf87db000 uarg=0000000000000000 20000000:01000000:2.0:1789601426.295278:0:11152:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789601426.295287:0:11152:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789601426.295294:0:11152:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789601426.299411:0:11153:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789601426.303802:0:11152:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789601426.316041:0:11152:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789601426.316201:0:11152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91edc0030800/0xf3d6e402158abff7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601426.316248:0:11152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edffadc200/0xf3d6e402158abfa3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abf9c expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601426.316256:0:11152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc3b89600/0xf3d6e402158abfb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abfaa expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601426.316263:0:11152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc3b89400/0xf3d6e402158abfbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abfb8 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601426.316274:0:11152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158abfc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f71 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601426.316281:0:11152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc0030600/0xf3d6e402158abfdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fa9 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601426.316288:0:11152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91edc0030800/0xf3d6e402158abff7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601426.316349:0:11152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc0030600/0xf3d6e402158abfdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fa9 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601426.316371:0:11152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91edc0030600/0xf3d6e402158abfdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fa9 expref: 12 pid: 5830 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601426.316390:0:11152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b18a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11152:1876532880525056:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789601426.316549:0:11152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158abfc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f71 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601426.316559:0:11152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158abfc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f71 expref: 12 pid: 5832 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601426.316575:0:11152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11152:1876532880525184:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789601426.316610:0:11152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc3b89400/0xf3d6e402158abfbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abfb8 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601426.316619:0:11152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edc3b89400/0xf3d6e402158abfbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abfb8 expref: 18 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601426.316628:0:11152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11152:1876532880525312:0@lo:104: 00000100:00100000:0.0:1789601426.316676:0:11152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789601426.316716:0:11152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc3b89600/0xf3d6e402158abfb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abfaa expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601426.316724:0:11152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edc3b89600/0xf3d6e402158abfb1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abfaa expref: 18 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601426.316733:0:11152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11152:1876532880525440:0@lo:104: 00000100:00100000:0.0:1789601426.316775:0:11152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789601426.316822:0:11152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edffadc200/0xf3d6e402158abfa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abf9c expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601426.316831:0:11152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edffadc200/0xf3d6e402158abfa3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abf9c expref: 18 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601426.316863:0:11152:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edfff51180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11152:1876532880525568:0@lo:104: 00000100:00100000:0.0:1789601426.316887:0:11152:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601426.316905:0:11152:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8a1b180 going to sleep for 11 seconds 00000100:00100000:1.0:1789601426.316984:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880525312 00000100:00100000:1.0:1789601426.316995:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880525312 00000100:00100000:1.0:1789601426.317046:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880525440 00000100:00100000:1.0:1789601426.317049:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880525440 00000100:00100000:1.0:1789601426.317061:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880525568 00000100:00100000:1.0:1789601426.317063:0:5820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880525568 00000100:00100000:1.0:1789601426.317076:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789601426.317086:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+5:11152:x1876532880525312:12345-0@lo:104: 00010000:00010000:1.0:1789601426.317101:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc0030c00/0xf3d6e402158abfb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abfbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.317170:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789601426.317178:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+5:11152:x1876532880525312:12345-0@lo:104: Request processed in 93us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601426.317185:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789601426.317204:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789601426.317209:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+4:11152:x1876532880525440:12345-0@lo:104: 00010000:00010000:1.0:1789601426.317216:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abfaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abfb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.317246:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789601426.317252:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+4:11152:x1876532880525440:12345-0@lo:104: Request processed in 42us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601426.317257:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789601426.317267:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789601426.317271:0:5820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:11152:x1876532880525568:12345-0@lo:104: 00010000:00010000:1.0:1789601426.317278:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158abf9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abfa3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.317315:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789601426.317320:0:5820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:11152:x1876532880525568:12345-0@lo:104: Request processed in 48us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601426.317326:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789601426.317341:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789601426.317348:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc0030c00/0xf3d6e402158abfb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abfbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.317356:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030c00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601426.317361:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc0030c00/0xf3d6e402158abfb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abfbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.317370:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc0030c00/0xf3d6e402158abfb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abfbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601426.317377:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc0030c00/0xf3d6e402158abfb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abfbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601426.317384:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789601426.317435:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc0030c00/0xf3d6e402158abfb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abfbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.317442:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601426.317586:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc0030c00/0xf3d6e402158abfb8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abfbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.317593:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc0030c00/0xf3d6e402158abfb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abfbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.317619:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789601426.317622:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abfaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abfb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.317627:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0031e00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601426.317630:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abfaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abfb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.317636:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abfaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abfb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601426.317642:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abfaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abfb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601426.317647:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789601426.317662:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abfaa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abfb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.317668:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601426.317673:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abfaa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abfb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.317679:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc0031e00/0xf3d6e402158abfaa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abfb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.317690:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601426.317692:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158abf9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158abfa3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.317707:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89200 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601426.317710:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158abf9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158abfa3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.317716:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158abf9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158abfa3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601426.317722:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158abf9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158abfa3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601426.317726:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789601426.317739:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158abf9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abfa3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.317745:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601426.317761:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158abf9c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abfa3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.317767:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158abf9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158abfa3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.317781:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601426.317783:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601426.317785:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601426.317800:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880525696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601426.317858:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601426.317889:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601426.317895:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880525824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601426.317929:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601426.317957:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601426.317966:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880525952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601426.317985:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601426.318009:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880525696 00000100:00100000:1.0:1789601426.318013:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880525696 00010000:00010000:1.0:1789601426.318034:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc3b89400/0xf3d6e402158abfbf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abfb8 expref: 19 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601426.318057:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880525824 00000100:00100000:1.0:1789601426.318060:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880525824 00010000:00010000:1.0:1789601426.318071:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc3b89600/0xf3d6e402158abfb1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abfaa expref: 20 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601426.318080:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880525952 00000100:00100000:1.0:1789601426.318083:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880525952 00010000:00010000:1.0:1789601426.318092:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edffadc200/0xf3d6e402158abfa3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abf9c expref: 21 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601426.318104:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789601426.318109:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede51e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+21:3317:x1876532880525696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789601426.318121:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601426.318126:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc3b89400/0xf3d6e402158abfbf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abfb8 expref: 21 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.318135:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc3b89400/0xf3d6e402158abfbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abfb8 expref: 21 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.318152:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601426.318181:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede51e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+21:3317:x1876532880525696:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601426.318195:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789601426.318235:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789601426.318242:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+20:3317:x1876532880525824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789601426.318248:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601426.318253:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc3b89600/0xf3d6e402158abfb1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abfaa expref: 20 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.318260:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc3b89600/0xf3d6e402158abfb1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abfaa expref: 20 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.318270:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601426.318289:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+20:3317:x1876532880525824:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601426.318295:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789601426.318306:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789601426.318311:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880525952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789601426.318318:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601426.318321:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edffadc200/0xf3d6e402158abfa3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abf9c expref: 19 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.318329:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edffadc200/0xf3d6e402158abfa3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abf9c expref: 19 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601426.318338:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601426.318362:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880525952:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601426.318368:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789601426.318414:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880525952:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789601426.321373:0:11152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc3b89400/0xf3d6e402158abfbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abfb8 expref: 18 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601426.321433:0:11152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11152:1876532880525312:0@lo:104: 00010000:00010000:0.0:1789601426.321448:0:11152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc3b89600/0xf3d6e402158abfb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abfaa expref: 17 pid: 5830 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601426.321465:0:11152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11152:1876532880525440:0@lo:104: 00010000:00010000:0.0:1789601426.321476:0:11152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edffadc200/0xf3d6e402158abfa3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abf9c expref: 16 pid: 5831 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601426.321483:0:11152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edfff51180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11152:1876532880525568:0@lo:104: 00000100:00100000:0.0:1789601426.321505:0:11152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b18a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11152:1876532880525056:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789601426.321533:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601426.322059:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880525824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601426.322071:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880525696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601426.322164:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858469376 00000100:00100000:0.0:1789601426.322174:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858469376 00010000:00010000:0.0:1789601426.322218:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc0030600/0xf3d6e402158abfdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fa9 expref: 13 pid: 5830 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601426.322260:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:0.0:1789601426.322271:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2356:x1876532858469376:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601426.322289:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601426.322295:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc0030600/0xf3d6e402158abfdb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fa9 expref: 13 pid: 5830 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601426.322307:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc0030600/0xf3d6e402158abfdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fa9 expref: 13 pid: 5830 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601426.322328:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc0030600/0xf3d6e402158abfdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fa9 expref: 13 pid: 5830 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601426.322356:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601426.322434:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:2356:x1876532858469376:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 164us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601426.322442:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:0.0:1789601426.322500:0:11152:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11152:1876532880525184:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789601426.322529:0:11152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91edc0030800/0xf3d6e402158abff7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601426.323039:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601426.324610:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601426.325302:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858469504 00000100:00100000:2.0:1789601426.325318:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858469504 00010000:00010000:2.0:1789601426.325366:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158abfc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f71 expref: 12 pid: 5832 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601426.325412:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:2.0:1789601426.325431:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:2357:x1876532858469504:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601426.325459:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601426.325465:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158abfc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f71 expref: 12 pid: 5832 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601426.325480:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158abfc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f71 expref: 12 pid: 5832 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601426.325514:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158abfc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f71 expref: 12 pid: 5832 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601426.325561:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91edc0030800/0xf3d6e402158abff7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601426.325580:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc0030800/0xf3d6e402158abff7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601426.325600:0:8437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edc0030800/0xf3d6e402158abff7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601426.325772:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edc0030800/0xf3d6e402158abff7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601426.325782:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91edc0030800/0xf3d6e402158abff7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601426.325790:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91edc0030800/0xf3d6e402158abff7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601426.325797:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030800 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601426.325802:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91edc0030800/0xf3d6e402158abff7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601426.325811:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91edc0030800/0xf3d6e402158abff7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601426.337785:0:11152:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91edc0030800/0xf3d6e402158abff7 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601426.337810:0:11152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91edc0030800/0xf3d6e402158abff7 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601426.352278:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91edc0030800/0xf3d6e402158abff7 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601426.352307:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc0030800/0xf3d6e402158abff7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601426.352370:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601426.360100:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+11:2357:x1876532858469504:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 34650us (35517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601426.360122:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00010000:00010000:1.0:1789601426.441319:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789601427.400988:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789601427.401000:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91edc7b4a800 from 7 10000000:01000000:3.0:1789601427.401007:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789601427.401077:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158abffe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601427.401092:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158abffe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601427.401108:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158abffe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601427.401152:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880526080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789601427.401269:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601427.401354:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc51c7000 going to sleep for 11 seconds 00000100:00100000:0.0:1789601427.401379:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880526080 00000100:00100000:0.0:1789601427.401390:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880526080 00000100:00100000:0.0:1789601427.401476:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789601427.401488:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:5834:x1876532880526080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789601427.401504:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601427.401522:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc0030600/0xf3d6e402158ac005 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158abffe expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601427.401550:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc0030600/0xf3d6e402158ac005 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158abffe expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601427.401575:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc0030600/0xf3d6e402158ac005 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abffe expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601427.401586:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc0030600, rc 0) 00000100:00100000:0.0:1789601427.401646:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880526080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601427.401653:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789601427.401941:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880526080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601427.401961:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158abffe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac005 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601427.401971:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158abffe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ac005 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601427.402042:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880526208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601427.402075:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601427.402117:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ee002b1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789601427.402561:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880526208 00000100:00100000:0.0:1789601427.402567:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880526208 00000100:00100000:0.0:1789601427.402609:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789601427.402617:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880526208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601427.403009:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880526208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 392us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601427.403017:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789601427.403956:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880526208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601427.404022:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880526336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601427.404595:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601427.404661:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ee002b1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601427.404884:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880526336 00000100:00100000:3.0:1789601427.404894:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880526336 00000100:00100000:3.0:1789601427.404953:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789601427.404964:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880526336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601427.405200:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880526336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 237us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601427.405208:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789601427.406578:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880526336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601427.406685:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880526720:0@lo:400:kworker.0 00000100:00100000:1.0:1789601427.406688:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880526464:0@lo:400:kworker.0 00000100:00100000:1.0:1789601427.406787:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601427.406803:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601427.406890:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601427.406899:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880526592:0@lo:400:kworker.0 00000100:00100000:3.0:1789601427.407110:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876532880526848:0@lo:400:kworker.0 00000100:00100000:1.0:1789601427.409877:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880526976:0@lo:400:kworker.0 00000100:00100000:0.0:1789601427.410632:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880526464 00000100:00100000:0.0:1789601427.410648:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880526464 00000100:00100000:0.0:1789601427.410715:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789601427.410724:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880526464:12345-0@lo:400:kworker.0 00000040:00080000:2.0:1789601427.412530:0:11165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000100:00100000:0.0:1789601427.413584:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880526464:12345-0@lo:400:kworker.0 Request processed in 2853us (6791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601427.413599:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789601427.413661:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880526720 00000100:00100000:0.0:1789601427.413668:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880526720 00000100:00100000:0.0:1789601427.413719:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789601427.413727:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880526720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601427.415213:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880526720:12345-0@lo:400:kworker.0 Request processed in 60us (6986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601427.415228:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789601427.415264:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601427.415283:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1789601427.415630:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789601427.415662:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789601427.415677:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158abffe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac005 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601427.415694:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158abffe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac005 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601427.415731:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789601427.415734:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91edc825a800 from 7 10000000:01000000:2.0:1789601427.415737:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789601427.415783:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4a00/0xf3d6e402158ac00c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601427.415792:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc29c4a00/0xf3d6e402158ac00c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601427.415805:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc29c4a00/0xf3d6e402158ac00c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601427.415833:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880527104:0@lo:101:ll_cfg_requeue.0 00010000:00080000:0.0:1789601427.415925:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00a5aa00 x1876532880526720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601427.415932:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601427.415949:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880526720:0@lo:400:kworker.0 00000100:00100000:2.0:1789601427.415993:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ee002b16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601427.416097:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880526592 00000100:00100000:0.0:1789601427.416105:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880526592 00000100:00100000:0.0:1789601427.416148:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789601427.416600:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880526592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601427.416675:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880526592:12345-0@lo:400:kworker.0 Request processed in 80us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601427.416681:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1789601427.416699:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601427.417141:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601427.417230:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880526464:0@lo:400:kworker.0 00000100:00100000:3.0:1789601427.417308:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601427.417420:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880527104 00000100:00100000:2.0:1789601427.417428:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880527104 00000100:00100000:2.0:1789601427.417487:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789601427.417496:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880527104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601427.417513:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601427.417533:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc29c5e00/0xf3d6e402158ac013 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158ac00c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601427.417563:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c5e00/0xf3d6e402158ac013 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158ac00c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601427.417576:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc29c5e00/0xf3d6e402158ac013 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ac00c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601427.417605:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c5e00, rc 0) 00000100:00100000:2.0:1789601427.417661:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880527104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601427.417668:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789601427.417722:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880527104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601427.417741:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc29c4a00/0xf3d6e402158ac00c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac013 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601427.417751:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc29c4a00/0xf3d6e402158ac00c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ac013 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601427.417824:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880527232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601427.417873:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601427.417900:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ee002b16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601427.417913:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880527232 00000100:00100000:2.0:1789601427.417917:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880527232 00000100:00100000:2.0:1789601427.417938:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789601427.417944:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880527232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601427.418246:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880527232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 301us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601427.418254:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789601427.418288:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880527232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601427.418317:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880527360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601427.418359:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601427.418382:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ee002b16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601427.418396:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880527360 00000100:00100000:2.0:1789601427.418400:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880527360 00000100:00100000:2.0:1789601427.418422:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789601427.418428:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880527360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601427.418603:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880527360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601427.418610:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789601427.418650:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880527360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789601427.419445:0:11166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789601427.423193:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789601427.423745:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789601427.423772:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4a00/0xf3d6e402158ac00c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac013 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601427.423789:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc29c4a00/0xf3d6e402158ac00c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac013 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601427.423803:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789601427.423806:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91edd1466000 from 7 10000000:01000000:2.0:1789601427.423810:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789601427.423892:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ac01a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601427.423903:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ac01a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601427.423916:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ac01a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601427.424060:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880526592:0@lo:400:kworker.0 00000100:00100000:0.0:1789601427.424127:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880526848 00000100:00100000:0.0:1789601427.424133:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880526848 00000100:00100000:0.0:1789601427.424207:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789601427.424215:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876532880526848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601427.424289:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876532880526848:12345-0@lo:400:kworker.0 Request processed in 75us (6981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601427.424311:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1789601427.424331:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601427.424955:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880526976 00000100:00100000:0.0:1789601427.424962:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880526976 00000100:00100000:0.0:1789601427.425093:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789601427.425101:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880526976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601427.425141:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880526976:12345-0@lo:400:kworker.0 Request processed in 42us (8004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601427.425147:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1789601427.425218:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601427.425622:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880527488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789601427.425704:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601427.425758:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc5150300 going to sleep for 11 seconds 00000100:00100000:2.0:1789601427.425917:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880527488 00000100:00100000:2.0:1789601427.425925:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880527488 00000100:00100000:2.0:1789601427.425972:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789601427.425981:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880527488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601427.425998:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601427.426020:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc29c5800/0xf3d6e402158ac021 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158ac01a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601427.426053:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c5800/0xf3d6e402158ac021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158ac01a expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601427.426067:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc29c5800/0xf3d6e402158ac021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ac01a expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601427.426078:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c5800, rc 0) 00000100:00100000:2.0:1789601427.426117:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880527488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601427.426125:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789601427.430079:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880527488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601427.430132:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ac01a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac021 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601427.430149:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ac01a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ac021 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601427.430375:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880527616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601427.430628:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601427.430669:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601427.430696:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876532880526848:0@lo:400:kworker.0 00000100:00100000:2.0:1789601427.430728:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ee002b1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601427.430753:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880527616 00000100:00100000:2.0:1789601427.430753:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858469632 00000100:00100000:3.0:1789601427.430760:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880527616 00000100:00100000:3.0:1789601427.430821:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789601427.430831:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880527616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601427.430856:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858469632 00000100:00100000:2.0:1789601427.430884:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 239 00000100:00100000:2.0:1789601427.430892:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+11:5599:x1876532858469632:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601427.430903:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601427.430924:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc29c5c00/0xf3d6e402158ac028 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f5060fd3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601427.430950:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c5c00/0xf3d6e402158ac028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fd3 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601427.430962:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc29c5c00/0xf3d6e402158ac028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fd3 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601427.430971:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c5c00, rc 0) 00000100:00100000:2.0:1789601427.431029:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:5599:x1876532858469632:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 138us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601427.431037:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 239 00000100:00100000:3.0:1789601427.431192:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880527616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601427.431213:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789601427.431227:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880527616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601427.431271:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880527744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601427.434009:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601427.434380:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880527744 00000100:00100000:3.0:1789601427.434403:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880527744 00000100:00100000:3.0:1789601427.434480:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789601427.434491:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880527744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601427.434716:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ee002b1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601427.434778:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880527744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 288us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601427.434793:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789601427.436400:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880527744:0@lo:503:ll_cfg_requeue.0 00010000:00080000:1.0:1789601427.440307:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edffa5b800 x1876532880526976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601427.440331:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880526976:0@lo:400:kworker.0 00000040:00080000:2.0:1789601427.443545:0:11167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789601427.444479:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789601427.444518:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789601427.444534:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ac01a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac021 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601427.444550:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ac01a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac021 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601427.447627:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601427.456031:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858469760 00000100:00100000:0.0:1789601427.456053:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858469760 00000100:00100000:0.0:1789601427.456157:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 241 00000100:00100000:0.0:1789601427.456170:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:5599:x1876532858469760:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601427.456829:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:5599:x1876532858469760:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 658us (9214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601427.456865:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 241 00000100:00100000:2.0:1789601427.461795:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601427.461887:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858469888 00000100:00100000:3.0:1789601427.461902:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858469888 00000100:00100000:3.0:1789601427.461956:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 242 00000100:00100000:3.0:1789601427.461967:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:5599:x1876532858469888:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601427.463778:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:5599:x1876532858469888:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 1805us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601427.463793:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 242 00010000:00010000:2.0:1789601427.465030:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601427.479364:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601427.479521:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858470016 00000100:00100000:3.0:1789601427.479546:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858470016 00000100:00100000:3.0:1789601427.479609:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 243 00000100:00100000:3.0:1789601427.479945:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:5599:x1876532858470016:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601427.479966:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601427.479985:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edffadc400/0xf3d6e402158ac02f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f5060fda expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601427.480014:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edffadc400/0xf3d6e402158ac02f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fda expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601427.480026:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edffadc400/0xf3d6e402158ac02f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fda expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601427.480035:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc400, rc 0) 00000100:00100000:3.0:1789601427.480103:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:5599:x1876532858470016:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 484us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601427.480129:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 243 00000100:00100000:2.0:1789601427.484450:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601427.484756:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858470144 00000100:00100000:3.0:1789601427.484771:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858470144 00000100:00100000:1.0:1789601427.484892:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 244 00000100:00100000:1.0:1789601427.484908:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:5599:x1876532858470144:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601427.485454:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:5599:x1876532858470144:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 546us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601427.485485:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 244 00000100:00100000:2.0:1789601427.493125:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601427.493975:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858470272 00000100:00100000:3.0:1789601427.493992:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858470272 00000100:00100000:3.0:1789601427.494074:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 245 00000100:00100000:3.0:1789601427.494088:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:5599:x1876532858470272:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601427.494397:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:5599:x1876532858470272:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 312us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601427.494407:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 245 00000100:00100000:0.0:1789601427.921626:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edfff50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880527872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601427.921737:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601427.921935:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880527872 00000100:00100000:1.0:1789601427.921947:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880527872 00000100:00100000:1.0:1789601427.922014:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789601427.922026:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880527872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601427.922072:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601427.922150:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880527872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601427.922158:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1789601427.922204:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edfff50380 x1876532880527872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601427.922226:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edfff50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880527872:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789601428.490829:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601429.522909:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601429.986349:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601429.986507:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601429.986560:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858470400 00000100:00100000:0.0:1789601429.986570:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858470400 00000100:00100000:0.0:1789601429.986629:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 246 00000100:00100000:0.0:1789601429.986639:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2358:x1876532858470400:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601429.986778:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2264450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2358:x1876532858470400:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 139us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601429.986794:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 246 00000100:00100000:0.0:1789601429.986826:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858470528 00000100:00100000:0.0:1789601429.986830:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858470528 00000100:00100000:0.0:1789601429.987409:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 100 00000100:00100000:0.0:1789601429.987430:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2358:x1876532858470528:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601429.987475:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2358:x1876532858470528:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 58us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601429.987481:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 100 00000100:00080000:0.0:1789601429.987547:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601429.990350:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601429.990553:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858470656 00000100:00100000:3.0:1789601429.990562:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858470656 00000100:00100000:3.0:1789601429.991501:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00100000:3.0:1789601429.991513:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+5:2359:x1876532858470656:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601429.991598:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+5:2359:x1876532858470656:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 87us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601429.991606:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00080000:1.0:1789601429.994497:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601430.481577:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601430.481601:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880528000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601430.481681:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601430.481760:0:10225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880528000 00000100:00100000:2.0:1789601430.481769:0:10225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880528000 00000100:00100000:2.0:1789601430.481823:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789601430.481831:0:10225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880528000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601430.481883:0:10225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601430.482191:0:10225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880528000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 360us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601430.482199:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1789601430.482220:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789601430.482254:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00b8d180 x1876532880528000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601430.482274:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880528000:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789601430.537509:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601431.581968:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601432.522735:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880528256:0@lo:400:kworker.0 00000100:00100000:1.0:1789601432.522804:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601432.522874:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880528768:0@lo:400:kworker.0 00000100:00100000:1.0:1789601432.522896:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601432.523081:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880528128:0@lo:400:kworker.0 00000100:00100000:2.0:1789601432.523795:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880528512:0@lo:400:kworker.0 00000100:00100000:0.0:1789601432.527985:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880528256 00000100:00100000:0.0:1789601432.528007:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880528256 00000100:00100000:0.0:1789601432.528081:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789601432.528094:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880528256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601432.537300:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601432.537355:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876532880528640:0@lo:400:kworker.0 00000100:00100000:3.0:1789601432.537413:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601432.537469:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880528128 00000100:00100000:3.0:1789601432.537479:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880528128 00000100:00100000:3.0:1789601432.537524:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789601432.537548:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3319:x1876532880528128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601432.537601:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3319:x1876532880528128:12345-0@lo:400:kworker.0 Request processed in 54us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601432.537607:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789601432.537635:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880528640 00000100:00100000:3.0:1789601432.537639:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880528640 00000100:00100000:3.0:1789601432.537669:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789601432.537676:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876532880528640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601432.537705:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876532880528640:12345-0@lo:400:kworker.0 Request processed in 30us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601432.537710:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789601432.537748:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880528128:0@lo:400:kworker.0 00000100:00100000:3.0:1789601432.537764:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876532880528640:0@lo:400:kworker.0 00000100:00100000:2.0:1789601432.548652:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601432.548725:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789601432.548739:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880528384:0@lo:400:kworker.0 00000100:00100000:2.0:1789601432.548799:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789601432.548876:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601432.549420:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880528384 00000100:00100000:3.0:1789601432.549430:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880528384 00000100:00100000:3.0:1789601432.549488:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789601432.549496:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880528384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601432.549560:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880528384:12345-0@lo:400:kworker.0 Request processed in 65us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601432.549567:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1789601432.549586:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601432.549623:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880528384:0@lo:400:kworker.0 00000100:00100000:1.0:1789601432.567276:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880528768 00000100:00100000:1.0:1789601432.567292:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880528768 00000100:00100000:1.0:1789601432.567459:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880528512 00000100:00100000:1.0:1789601432.567477:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880528512 00000100:00080000:3.0:1789601432.567698:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601432.568277:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789601432.568289:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880528768:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789601432.568683:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601432.576445:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880528256:12345-0@lo:400:kworker.0 Request processed in 48340us (53625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601432.576464:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789601432.576787:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880528768:12345-0@lo:400:kworker.0 Request processed in 8491us (53879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601432.576803:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789601432.576853:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789601432.576869:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880528512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601432.577029:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880528512:12345-0@lo:400:kworker.0 Request processed in 166us (28383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601432.577036:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1789601432.577087:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edffa5a680 x1876532880528768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601432.577103:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880528768:0@lo:400:kworker.0 00000100:00100000:1.0:1789601432.577147:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880528256:0@lo:400:kworker.0 00010000:00080000:0.0:1789601432.578027:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edffa59f80 x1876532880528512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601432.578060:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880528512:0@lo:400:kworker.0 00010000:00010000:1.0:1789601432.586212:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601433.049060:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edfff51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880528896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601433.049151:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601433.049231:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880528896 00000100:00100000:3.0:1789601433.049263:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880528896 00000100:00100000:3.0:1789601433.049358:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789601433.049386:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880528896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789601433.049443:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789601433.059046:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880528896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9660us (9877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601433.059068:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1789601433.072911:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edfff51f80 x1876532880528896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601433.072944:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edfff51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880528896:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1789601433.410546:0:11350:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789601433.609773:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601434.633233:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601435.097820:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601435.097919:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601435.097964:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601435.098394:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858470784 00000100:00100000:0.0:1789601435.098409:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858470784 00000100:00100000:0.0:1789601435.098485:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 248 00000100:00100000:0.0:1789601435.098497:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2359:x1876532858470784:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601435.098613:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2359:x1876532858470784:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 117us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601435.098633:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 248 00000100:00100000:2.0:1789601435.098988:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858471040 00000100:00100000:2.0:1789601435.098994:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858471040 00000100:00100000:2.0:1789601435.099068:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858470912 00000100:00100000:2.0:1789601435.099072:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858470912 00000100:00100000:2.0:1789601435.099096:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 105 00000100:00100000:2.0:1789601435.099103:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85db4f7d-704a-4080-a137-b2930e072a8c+5:2359:x1876532858471040:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601435.099147:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85db4f7d-704a-4080-a137-b2930e072a8c+5:2359:x1876532858471040:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 44us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601435.099154:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 105 00000100:00100000:2.0:1789601435.099168:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 106 00000100:00100000:2.0:1789601435.099186:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2359:x1876532858470912:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601435.099207:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2359:x1876532858470912:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601435.099212:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 106 00000100:00080000:0.0:1789601435.099981:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601435.593189:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880529024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601435.593285:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601435.593771:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880529024 00000100:00100000:2.0:1789601435.593783:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880529024 00000100:00100000:2.0:1789601435.593915:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789601435.593927:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880529024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601435.594251:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601435.594346:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880529024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 422us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601435.594354:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1789601435.594672:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edffa58380 x1876532880529024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601435.594693:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880529024:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789601435.594765:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789601435.657293:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601436.686591:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601437.641557:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880529536:0@lo:400:kworker.0 00000100:00100000:1.0:1789601437.641627:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601437.641691:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789601437.641697:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880529408:0@lo:400:kworker.0 00000100:00100000:1.0:1789601437.641738:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601437.641771:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880529536 00000100:00100000:1.0:1789601437.641780:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880529536 00000100:00100000:1.0:1789601437.641863:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789601437.641873:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880529536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601437.641923:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880529536:12345-0@lo:400:kworker.0 Request processed in 51us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601437.641931:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789601437.641953:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880529408 00000100:00100000:1.0:1789601437.641957:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880529408 00000100:00100000:1.0:1789601437.641984:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789601437.641991:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880529408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601437.642021:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880529408:12345-0@lo:400:kworker.0 Request processed in 31us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601437.642028:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789601437.642064:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880529408:0@lo:400:kworker.0 00010000:00080000:1.0:1789601437.642076:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edffa5a300 x1876532880529536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601437.642086:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880529536:0@lo:400:kworker.0 00000100:00100000:2.0:1789601437.642275:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880529280:0@lo:400:kworker.0 00000100:00100000:2.0:1789601437.642316:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601437.642349:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880529792:0@lo:400:kworker.0 00000100:00100000:2.0:1789601437.642371:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601437.642393:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789601437.642398:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880529152:0@lo:400:kworker.0 00000100:00100000:2.0:1789601437.642424:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601437.642443:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880529664:0@lo:400:kworker.0 00000100:00100000:2.0:1789601437.642462:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601437.642797:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880529280 00000100:00100000:1.0:1789601437.642802:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880529280 00000100:00100000:1.0:1789601437.642918:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880529664 00000100:00100000:1.0:1789601437.642922:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880529664 00000100:00100000:1.0:1789601437.642944:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789601437.642951:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880529280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601437.642988:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880529280:12345-0@lo:400:kworker.0 Request processed in 37us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601437.643004:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789601437.643016:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789601437.643021:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880529664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601437.643047:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880529664:12345-0@lo:400:kworker.0 Request processed in 27us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601437.643052:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789601437.643646:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880529664:0@lo:400:kworker.0 00000100:00100000:2.0:1789601437.643658:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880529280:0@lo:400:kworker.0 00000100:00080000:0.0:1789601437.643805:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789601437.643810:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601437.643821:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880529792 00000100:00100000:0.0:1789601437.643825:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880529792 00000100:00100000:0.0:1789601437.643886:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789601437.643895:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880529792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601437.643935:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880529792:12345-0@lo:400:kworker.0 Request processed in 43us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601437.643942:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789601437.643963:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880529152 00000100:00100000:0.0:1789601437.643967:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880529152 00000100:00100000:0.0:1789601437.643987:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789601437.643993:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880529152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601437.644019:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2267050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880529152:12345-0@lo:400:kworker.0 Request processed in 26us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601437.644025:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00080000:2.0:1789601437.644104:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601437.644121:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880529152:0@lo:400:kworker.0 00010000:00080000:2.0:1789601437.644132:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edffa58a80 x1876532880529792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601437.644141:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880529792:0@lo:400:kworker.0 00010000:00010000:3.0:1789601437.715389:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601438.153253:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789601438.153293:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edfff52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880529920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601438.153361:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601438.153504:0:10225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880529920 00000100:00100000:2.0:1789601438.153513:0:10225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880529920 00000100:00100000:2.0:1789601438.153566:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789601438.153576:0:10225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880529920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601438.153623:0:10225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601438.153682:0:10225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880529920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601438.153699:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1789601438.154144:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edfff52680 x1876532880529920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601438.154164:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edfff52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880529920:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789601438.729003:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789601439.430306:0:11449:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 19:30:38 (1789601438) === 00010000:00010000:3.0:1789601439.755029:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601439.859946:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601439.861577:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858471168 00000100:00100000:1.0:1789601439.861597:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858471168 00000100:00100000:1.0:1789601439.861723:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:1.0:1789601439.861741:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858471168:12345-192.168.201.30@tcp:41:mkdir.0 00000004:00000024:1.0:1789601439.861815:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789601439.861988:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858471168:12345-192.168.201.30@tcp:41:mkdir.0 Request processed in 254us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601439.861996:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00080000:2.0:1789601439.862619:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601439.865498:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601439.868713:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858471296 00000100:00100000:2.0:1789601439.868738:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858471296 00000100:00100000:2.0:1789601439.868881:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:2.0:1789601439.868895:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:9682:x1876532858471296:12345-192.168.201.30@tcp:700:mkdir.0 00000100:00100000:2.0:1789601439.869031:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:9682:x1876532858471296:12345-192.168.201.30@tcp:700:mkdir.0 Request processed in 139us (3544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601439.869040:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:1.0:1789601439.874086:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601439.874198:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858471552 00000100:00100000:2.0:1789601439.874211:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858471552 00000100:00100000:2.0:1789601439.874341:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:2.0:1789601439.874363:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:9682:x1876532858471552:12345-192.168.201.30@tcp:36:mkdir.0 00010000:00010000:2.0:1789601439.874449:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601439.888996:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88200/0xf3d6e402158abf17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f5c expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601439.889025:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd35e8b00) 00010000:00010000:2.0:1789601439.889764:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601439.891640:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac036 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601439.891661:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac036 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601439.891688:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac036 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601439.891741:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c200/0xf3d6e402158ac03d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601439.891750:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c200/0xf3d6e402158ac03d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601439.891758:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c200/0xf3d6e402158ac03d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601439.909769:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789601439.909788:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac036 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601439.909799:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac036 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601439.909820:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac036 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601439.909826:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8dc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601439.909831:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac036 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601439.909871:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac036 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601439.909889:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8a67100) 00010000:00010000:2.0:1789601439.909893:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601439.909904:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac036 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601439.909911:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac036 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601439.909932:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4978d1d reply state 000000007c73f43d transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c200/0xf3d6e402158ac03d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601439.909940:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789601439.910054:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:9682:x1876532858471552:12345-192.168.201.30@tcp:36:mkdir.0 Request processed in 35690us (35978us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789601439.910064:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00010000:00010000:3.0:1789601439.920136:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c200/0xf3d6e402158ac03d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601439.920165:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c200/0xf3d6e402158ac03d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601439.920175:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c200/0xf3d6e402158ac03d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601439.920185:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601439.920191:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c200/0xf3d6e402158ac03d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601439.920204:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c200/0xf3d6e402158ac03d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601439.920272:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91edd8a67300) 00010000:00010000:3.0:1789601439.920276:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601439.920283:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c200/0xf3d6e402158ac03d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601439.920291:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c200/0xf3d6e402158ac03d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601439.945192:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601439.945519:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858471680 00000100:00100000:0.0:1789601439.945531:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858471680 00000100:00100000:0.0:1789601439.945595:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1789601439.945606:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:9685:x1876532858471680:12345-192.168.201.30@tcp:101:chmod.0 00010000:00010000:0.0:1789601439.945635:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601439.945666:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030c00/0xf3d6e402158ac044 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5060fe1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601439.945748:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031e00/0xf3d6e402158ac04b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601439.945763:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031e00/0xf3d6e402158ac04b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601439.945942:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031e00/0xf3d6e402158ac04b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601439.945989:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789601439.945993:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789601439.946034:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031e00/0xf3d6e402158ac04b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601439.946065:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030c00/0xf3d6e402158ac044 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fe1 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601439.946087:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031e00/0xf3d6e402158ac04b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fe1 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601439.946107:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd0646600) 00010000:00010000:0.0:1789601439.946123:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789601439.946128:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc0031e00, rc 0) 00000100:00100000:0.0:1789601439.946198:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:9685:x1876532858471680:12345-192.168.201.30@tcp:101:chmod.0 Request processed in 595us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601439.946205:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:1.0:1789601439.949910:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601439.950141:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858471936 00000100:00100000:0.0:1789601439.950156:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858471936 00000100:00100000:0.0:1789601439.950231:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:0.0:1789601439.950252:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:9685:x1876532858471936:12345-192.168.201.30@tcp:36:chmod.0 00010000:00010000:0.0:1789601439.950326:0:8248:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601439.950378:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031e00/0xf3d6e402158ac04b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fe1 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601439.950406:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd0646600) 00010000:00010000:0.0:1789601439.950421:0:8248:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789601439.950454:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac052 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601439.950469:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac052 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601439.950479:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac052 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789601439.952080:0:8248:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d5a7ca6 reply state 00000000e0740cdf transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac052 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601439.952175:0:8248:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789601439.952191:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789601439.952614:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:9685:x1876532858471936:12345-192.168.201.30@tcp:36:chmod.0 Request processed in 2366us (2710us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789601439.952640:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00010000:00010000:0.0:1789601439.956950:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac052 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601439.956974:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac052 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601439.956985:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac052 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601439.956993:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601439.956999:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac052 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601439.957008:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac052 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601439.957029:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd0646000) 00010000:00010000:0.0:1789601439.957033:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789601439.957039:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac052 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601439.957045:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac052 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601440.018049:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601440.019126:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858472064 00000100:00100000:0.0:1789601440.019143:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858472064 00000100:00100000:0.0:1789601440.019238:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:0.0:1789601440.019260:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:9686:x1876532858472064:12345-192.168.201.30@tcp:101:chown.0 00010000:00010000:0.0:1789601440.019294:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601440.019345:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac059 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5060fe8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.019433:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031e00/0xf3d6e402158ac060 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.019451:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031e00/0xf3d6e402158ac060 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.019467:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031e00/0xf3d6e402158ac060 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601440.019513:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789601440.019519:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789601440.019567:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031e00/0xf3d6e402158ac060 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.019600:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac059 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fe8 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.019628:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031e00/0xf3d6e402158ac060 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fe8 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.019638:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd0646000) 00010000:00010000:0.0:1789601440.019641:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789601440.019645:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc0031e00, rc 0) 00000100:00100000:0.0:1789601440.019745:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:9686:x1876532858472064:12345-192.168.201.30@tcp:101:chown.0 Request processed in 489us (1710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601440.019752:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:2.0:1789601440.023198:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601440.024767:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858472192 00000100:00100000:3.0:1789601440.024789:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858472192 00000100:00100000:2.0:1789601440.025082:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:2.0:1789601440.025107:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:9686:x1876532858472192:12345-192.168.201.30@tcp:101:chown.0 00010000:00010000:2.0:1789601440.025136:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601440.025164:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac067 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5060fef expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025257:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac06e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025276:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac06e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025290:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac06e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025306:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac075 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025338:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025347:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025663:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac07c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025672:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac07c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025680:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac07c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601440.025720:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789601440.025725:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789601440.025752:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac07c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025766:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac06e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025773:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac06e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025780:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac06e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025787:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601440.025792:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac06e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025808:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac06e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025823:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd0646000) 00010000:00010000:2.0:1789601440.025826:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601440.025832:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac06e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025871:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac06e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025890:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac075 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025896:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac075 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025901:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac075 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025907:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601440.025910:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac075 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025915:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac075 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025922:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91edd8a67100) 00010000:00010000:2.0:1789601440.025924:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601440.025927:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac075 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025943:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac075 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.025986:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac067 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fef expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.026003:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac07c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fef expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.026011:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91edd8a67e00) 00010000:00010000:2.0:1789601440.026013:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789601440.026015:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8da00, rc 0) 00000100:00100000:2.0:1789601440.026410:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:9686:x1876532858472192:12345-192.168.201.30@tcp:101:chown.0 Request processed in 1316us (3226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601440.026421:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:2.0:1789601440.031679:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601440.032971:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858472448 00000100:00100000:0.0:1789601440.033011:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858472448 00000100:00100000:0.0:1789601440.033088:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:0.0:1789601440.033184:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:9686:x1876532858472448:12345-192.168.201.30@tcp:36:chown.0 00010000:00010000:0.0:1789601440.033276:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601440.033577:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac07c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fef expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.033605:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91edd8a67e00) 00010000:00010000:0.0:1789601440.033618:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789601440.033654:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac083 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.033670:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.033681:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789601440.090579:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1789601440.090831:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005be94723 reply state 0000000066d4aa96 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601440.090918:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789601440.091184:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1789601440.091508:0:5838:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789601440.091578:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8de9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:9686:x1876532858472448:12345-192.168.201.30@tcp:36:chown.0 Request processed in 58393us (59905us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789601440.091589:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00010000:00010000:3.0:1789601440.101147:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.101170:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac083 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.101180:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac083 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.101188:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601440.101194:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac083 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.101204:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac083 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.101227:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91edd0646600) 00010000:00010000:3.0:1789601440.101231:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789601440.101237:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac083 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.101279:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac083 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601440.110942:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601440.111063:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858472576 00000100:00100000:0.0:1789601440.111077:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858472576 00000100:00100000:0.0:1789601440.111155:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:0.0:1789601440.111185:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:9687:x1876532858472576:12345-192.168.201.30@tcp:101:touch.500 00010000:00010000:0.0:1789601440.111218:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601440.111256:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030c00/0xf3d6e402158ac08a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5060ff6 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789601440.115770:0:8248:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4442us 00010000:00010000:0.0:1789601440.132309:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac091 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.132338:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac091 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.132354:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac091 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.132375:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ac098 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.132382:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ac098 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.132400:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ac098 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.132799:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac09f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.132808:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac09f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.132815:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac09f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601440.132882:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789601440.132887:0:8248:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789601440.132936:0:8248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac09f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.132950:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac091 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.132956:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac091 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.132963:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac091 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.132969:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601440.132974:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac091 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.132982:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac091 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.132996:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd0646000) 00010000:00010000:0.0:1789601440.132999:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601440.133006:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac091 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.133012:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030800/0xf3d6e402158ac091 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.133026:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ac098 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.133042:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ac098 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.133048:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ac098 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.133053:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601440.133057:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ac098 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.133062:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ac098 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.133069:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91edd0646f00) 00010000:00010000:0.0:1789601440.133072:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601440.133075:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ac098 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.133081:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ac098 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.133132:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030c00/0xf3d6e402158ac08a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060ff6 expref: 8 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.133149:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac09f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060ff6 expref: 7 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.133157:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91edd0646d00) 00010000:00010000:0.0:1789601440.133160:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789601440.133168:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924c00, rc 0) 00000100:00100000:0.0:1789601440.133275:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8de9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:9687:x1876532858472576:12345-192.168.201.30@tcp:101:touch.500 Request processed in 22090us (22346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601440.133286:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:1.0:1789601440.138801:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601440.139054:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858472832 00000100:00100000:0.0:1789601440.139069:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858472832 00000100:00100000:0.0:1789601440.139186:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:0.0:1789601440.139200:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:9687:x1876532858472832:12345-192.168.201.30@tcp:101:touch.500 00010000:00010000:0.0:1789601440.139228:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601440.139265:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac0a6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5060ffd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.139633:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac0ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.139654:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac0ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.139668:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac0ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.145515:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ac0b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.145541:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ac0b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.145557:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ac0b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789601440.151749:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789601440.152509:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ac0bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601440.152535:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ac0bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601440.152550:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ac0bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601440.152602:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac0ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601440.152610:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac0ad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601440.152618:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac0ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601440.152625:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925a00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601440.152630:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac0ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601440.152638:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac0ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601440.152653:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91edd0646d00) 00010000:00010000:1.0:1789601440.152656:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601440.152662:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac0ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601440.152668:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac0ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789601440.152702:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027aa05c2 reply state 00000000b087d48f transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ac0b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601440.152712:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789601440.152761:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac0a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060ffd expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601440.152779:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ac0bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060ffd expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601440.152787:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91edd35e8200) 00010000:00010000:1.0:1789601440.152790:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601440.152792:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88a00, rc 0) 00000100:00100000:1.0:1789601440.152963:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+10:9687:x1876532858472832:12345-192.168.201.30@tcp:101:touch.500 Request processed in 13764us (14178us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789601440.152974:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:1.0:1789601440.158294:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:0.0:1789601440.158416:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ac0b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.158433:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ac0b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.158442:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ac0b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.158451:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601440.158458:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ac0b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.158466:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ac0b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.158488:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff91edd0646600) 00010000:00010000:0.0:1789601440.158491:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601440.158498:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ac0b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.158505:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ac0b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601440.160122:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858473088 00000100:00100000:3.0:1789601440.160143:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858473088 00000100:00100000:3.0:1789601440.160283:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:3.0:1789601440.160296:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:9687:x1876532858473088:12345-192.168.201.30@tcp:36:touch.500 00010000:00010000:3.0:1789601440.160933:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601440.160973:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ac0bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060ffd expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.160998:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91edd35e8200) 00010000:00010000:3.0:1789601440.161011:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601440.161074:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac0c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.161090:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.161102:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601440.161297:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041be17da reply state 0000000084e8264d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601440.161317:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789601440.161871:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+10:9687:x1876532858473088:12345-192.168.201.30@tcp:36:touch.500 Request processed in 1574us (3594us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789601440.161882:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:2.0:1789601440.167096:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601440.167246:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858473216 00000100:00100000:0.0:1789601440.167261:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858473216 00000100:00100000:0.0:1789601440.167357:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:0.0:1789601440.167373:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+10:9687:x1876532858473216:12345-192.168.201.30@tcp:101:touch.500 00010000:00010000:0.0:1789601440.167406:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601440.167433:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac0d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061004 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.167538:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac0d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061004 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.167557:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac0d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061004 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.167582:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91edd8ce5100) 00010000:00010000:0.0:1789601440.167585:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789601440.167590:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00925200, rc 0) 00000100:00100000:0.0:1789601440.167656:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8de8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+11:9687:x1876532858473216:12345-192.168.201.30@tcp:101:touch.500 Request processed in 286us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601440.167663:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00010000:00010000:3.0:1789601440.171637:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.171659:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac0c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.171667:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac0c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.171673:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadd400 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601440.171679:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac0c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.171686:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac0c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.171707:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91edd8ce5100) 00010000:00010000:3.0:1789601440.171710:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601440.171716:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac0c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.171722:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac0c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601440.172197:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601440.172317:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858473344 00000100:00100000:0.0:1789601440.172551:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858473344 00000100:00100000:0.0:1789601440.172671:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1789601440.172681:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1876532858473344:12345-192.168.201.30@tcp:8:touch.500 00010000:00080000:0.0:1789601440.172725:0:6677:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:0.0:1789601440.172765:0:6677:0:(genops.c:1384:class_connect()) connect: client 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6, cookie 0xf3d6e402158ac0d7 00002000:00100000:0.0:1789601440.172781:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6/ffff91edf9db7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789601440.172811:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789601440.173145:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789601440.173188:0:6677:0:(import.c:65:import_set_state_nolock()) ffff91edf9db1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601440.173382:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2355:x1876532858473344:12345-192.168.201.30@tcp:8:touch.500 Request processed in 699us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601440.173413:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:1.0:1789601440.176930:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601440.177046:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858473472 00000100:00100000:0.0:1789601440.177061:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858473472 00000100:00100000:0.0:1789601440.177207:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:0.0:1789601440.177223:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:0:x1876532858473472:12345-192.168.201.30@tcp:2:touch.500 00000100:00080000:2.0:1789601440.180687:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601440.214221:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601440.214291:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601440.214354:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858473728 00000100:00100000:1.0:1789601440.214376:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858473728 00000100:00100000:1.0:1789601440.214460:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 110 00000100:00100000:1.0:1789601440.214472:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85db4f7d-704a-4080-a137-b2930e072a8c+5:2358:x1876532858473728:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789601440.214569:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85db4f7d-704a-4080-a137-b2930e072a8c+5:2358:x1876532858473728:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 100us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601440.214594:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 110 00000100:00100000:2.0:1789601440.215708:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858473600 00000100:00100000:2.0:1789601440.215724:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858473600 00000100:00100000:2.0:1789601440.215817:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 250 00000100:00100000:2.0:1789601440.215831:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2358:x1876532858473600:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601440.215962:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2358:x1876532858473600:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 134us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601440.215970:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 250 00000100:00080000:2.0:1789601440.216023:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789601440.223165:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1789601440.223188:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 00000100:00100000:3.0:1789601440.223816:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:0:x1876532858473472:12345-192.168.201.30@tcp:2:touch.500 Request processed in 46588us (46976us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789601440.223829:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:1.0:1789601440.227011:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601440.227106:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858473984 00000100:00100000:3.0:1789601440.227120:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858473984 00000100:00100000:3.0:1789601440.227191:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:3.0:1789601440.227204:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+10:9687:x1876532858473984:12345-192.168.201.30@tcp:35:touch.500 00000100:00100000:3.0:1789601440.228011:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+11:9687:x1876532858473984:12345-192.168.201.30@tcp:35:touch.500 Request processed in 805us (1007us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789601440.228022:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:0.0:1789601440.240942:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601440.241259:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858474112 00000100:00100000:2.0:1789601440.241274:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858474112 00000100:00100000:2.0:1789601440.241634:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:2.0:1789601440.241649:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+11:9688:x1876532858474112:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1789601440.241681:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601440.241710:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac0de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506100b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.241796:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac0e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.241814:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.241827:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601440.241915:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789601440.241920:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789601440.241967:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac0e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.241999:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac0de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506100b expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.242021:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac0e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506100b expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.242053:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91edd0646d00) 00010000:00010000:2.0:1789601440.242057:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789601440.242061:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8d800, rc 0) 00000100:00100000:2.0:1789601440.242158:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+12:9688:x1876532858474112:12345-192.168.201.30@tcp:101:rm.0 Request processed in 513us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601440.248066:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:2.0:1789601440.250567:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601440.250680:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858474368 00000100:00100000:1.0:1789601440.250694:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858474368 00000100:00100000:1.0:1789601440.250762:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:1.0:1789601440.250773:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+12:9688:x1876532858474368:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:1.0:1789601440.250802:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601440.250828:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88200/0xf3d6e402158ac0ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061012 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601440.250987:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789601440.251208:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88200/0xf3d6e402158ac0ec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061012 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601440.251225:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd0646000) 00010000:00010000:1.0:1789601440.251228:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789601440.251234:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88200/0xf3d6e402158ac0ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061012 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601440.251263:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88200, rc 0) 00000100:00100000:1.0:1789601440.253212:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:9688:x1876532858474368:12345-192.168.201.30@tcp:101:rm.0 Request processed in 2423us (2642us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1789601440.253228:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:1.0:1789601440.268222:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601440.268332:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858474496 00000100:00100000:0.0:1789601440.268345:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858474496 00000100:00100000:0.0:1789601440.268685:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:0.0:1789601440.268699:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:9688:x1876532858474496:12345-192.168.201.30@tcp:37:rm.0 00000100:00100000:2.0:1789601440.276724:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:9688:x1876532858474496:12345-192.168.201.30@tcp:37:rm.0 Request processed in 8012us (8500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601440.276742:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:1.0:1789601440.289040:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601440.289228:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858474752 00000100:00100000:3.0:1789601440.289253:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858474752 00000100:00100000:3.0:1789601440.289340:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:3.0:1789601440.289352:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91eddcdac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:9688:x1876532858474752:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:3.0:1789601440.289975:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91eddcdac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:9688:x1876532858474752:12345-192.168.201.30@tcp:35:rm.0 Request processed in 619us (943us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789601440.289983:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:1.0:1789601440.298162:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601440.298338:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858475008 00000100:00100000:2.0:1789601440.298352:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858475008 00000100:00100000:2.0:1789601440.298435:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:2.0:1789601440.298447:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:9688:x1876532858475008:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1789601440.298478:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601440.298505:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac0fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061019 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.298636:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac101 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.298655:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac101 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.298669:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac101 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601440.298700:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789601440.298952:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac0fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061019 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.298975:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac101 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061019 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.298984:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91edd0646d00) 00010000:00010000:2.0:1789601440.298987:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789601440.298992:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8d200, rc 0) 00000100:00100000:2.0:1789601440.299071:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+16:9688:x1876532858475008:12345-192.168.201.30@tcp:101:rm.0 Request processed in 624us (922us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789601440.299079:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:0.0:1789601440.308558:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601440.308674:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858475136 00000100:00100000:1.0:1789601440.308687:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858475136 00000100:00100000:1.0:1789601440.308821:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:1.0:1789601440.308877:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+16:9688:x1876532858475136:12345-192.168.201.30@tcp:41:rm.0 00000004:00000024:1.0:1789601440.308960:0:8248:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1789601440.309059:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+16:9688:x1876532858475136:12345-192.168.201.30@tcp:41:rm.0 Request processed in 228us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601440.309067:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:3.0:1789601440.315183:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601440.320797:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858475264 00000100:00100000:2.0:1789601440.320822:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858475264 00000100:00100000:2.0:1789601440.322056:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:2.0:1789601440.322072:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+16:9688:x1876532858475264:12345-192.168.201.30@tcp:101:rm.0 00010000:00010000:2.0:1789601440.322101:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601440.322131:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac10f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061020 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.322218:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac116 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.322249:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac116 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.322291:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac116 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.322320:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac11d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.322595:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac11d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.322603:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac11d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.322738:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac124 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.322747:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.322754:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601440.322790:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789601440.322795:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789601440.322817:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.322829:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.323553:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac116 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.323582:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac116 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.323590:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac116 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.323596:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601440.323601:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac116 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.323609:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac116 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.323625:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91edd0646d00) 00010000:00010000:2.0:1789601440.323629:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601440.323634:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac116 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.323640:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac116 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.323658:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac11d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.323664:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac11d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.323670:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac11d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.323675:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601440.323684:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac11d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.323690:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac11d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.323699:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff91edd8a67f00) 00010000:00010000:2.0:1789601440.323701:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601440.323705:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac11d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.323711:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac11d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.323760:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac10f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061020 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.323774:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061020 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.323781:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91edd8ce5100) 00010000:00010000:2.0:1789601440.323783:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601440.323786:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8da00, rc 0) 00000100:00100000:2.0:1789601440.324985:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+17:9688:x1876532858475264:12345-192.168.201.30@tcp:101:rm.0 Request processed in 2906us (9807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601440.324998:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:0.0:1789601440.336708:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601440.340773:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858475520 00000100:00100000:3.0:1789601440.340795:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858475520 00000100:00100000:3.0:1789601440.341703:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:3.0:1789601440.341723:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+17:9688:x1876532858475520:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1789601440.341802:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789601440.341855:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac124 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061020 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.341887:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac0d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061004 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.341904:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91edd8ce5100) 00010000:00010000:3.0:1789601440.341925:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac0e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506100b expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.341961:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91edd0646d00) 00010000:00010000:3.0:1789601440.341965:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601440.341993:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac12b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.342009:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac12b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.342021:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac12b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.342036:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac132 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.342044:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac132 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.342052:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac132 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.342232:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac139 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.342251:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac139 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.342259:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac139 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789601440.344574:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1789601440.344597:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 310382759016ns, next at 311382753621ns, rc = 0 00010000:00010000:3.0:1789601440.344714:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac140 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.344733:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac140 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.344746:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac140 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.344756:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac140 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.344762:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac140 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.344768:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac140 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.344798:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789601440.344824:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac139 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.344830:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac139 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.344860:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac139 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.344867:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601440.344872:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac139 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.344880:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac139 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.344899:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91edd8ce5400) 00010000:00010000:3.0:1789601440.344902:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789601440.344908:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac139 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.344915:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac139 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.344937:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac12b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.344942:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac12b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.344947:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac12b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.344953:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadd400 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601440.344956:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac12b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.344961:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac12b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.344967:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91edd0646d00) 00010000:00010000:3.0:1789601440.344969:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601440.344972:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac12b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601440.344977:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd400/0xf3d6e402158ac12b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601440.344997:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089606229 reply state 0000000078610a9f transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac132 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601440.345006:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789601440.345127:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+16:9688:x1876532858475520:12345-192.168.201.30@tcp:36:rm.0 Request processed in 3408us (8487us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789601440.345138:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 30 00010000:00010000:1.0:1789601440.345249:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601440.345258:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac140 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601440.345265:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc800 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601440.345268:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac140 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601440.345275:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac140 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601440.345285:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91edd8ce5400) 00010000:00010000:1.0:1789601440.345287:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789601440.345290:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac140 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601440.345296:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac140 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601440.345332:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601440.345334:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601440.345336:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601440.349139:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac132 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.349163:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac132 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.349173:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac132 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.349180:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffaddc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601440.349186:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac132 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.349195:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac132 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.349270:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff91edd8ce5900) 00010000:00010000:0.0:1789601440.349274:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601440.349280:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac132 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601440.349288:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac132 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601440.356157:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601440.356634:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858475776 00000100:00100000:3.0:1789601440.356649:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858475776 00000100:00100000:3.0:1789601440.356731:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:3.0:1789601440.356743:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+15:9688:x1876532858475776:12345-192.168.201.30@tcp:35:rm.0 00000100:00100000:3.0:1789601440.357098:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+16:9688:x1876532858475776:12345-192.168.201.30@tcp:35:rm.0 Request processed in 355us (954us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789601440.357107:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:1.0:1789601440.361194:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601440.361421:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858476032 00000100:00100000:2.0:1789601440.361436:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858476032 00000100:00100000:2.0:1789601440.361510:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:2.0:1789601440.361522:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+16:9688:x1876532858476032:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1789601440.361617:0:8248:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789601440.361652:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac101 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061019 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.361680:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac09f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060ff6 expref: 15 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.361696:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91edd0646d00) 00010000:00010000:2.0:1789601440.361716:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031e00/0xf3d6e402158ac060 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fe8 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.361727:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd0646000) 00010000:00010000:2.0:1789601440.361734:0:8248:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601440.361763:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac147 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.361779:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac147 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.361791:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac147 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.361804:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac14e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.361812:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac14e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.361817:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac14e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.362171:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac155 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.362181:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac155 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.362189:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac155 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601440.362879:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789601440.362900:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac155 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.362909:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac155 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.362917:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac155 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.362923:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601440.362928:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac155 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.362937:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac155 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.362950:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91edd8a67100) 00010000:00010000:2.0:1789601440.362952:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789601440.362957:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac155 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.362973:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac155 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.362997:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac147 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.363003:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac147 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.363009:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac147 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.363015:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8cc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601440.363017:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac147 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.363022:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac147 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.363029:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8a67f00) 00010000:00010000:2.0:1789601440.363031:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601440.363033:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac147 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.363039:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac147 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601440.363050:0:8248:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073d273b7 reply state 0000000088d12057 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac14e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601440.363058:0:8248:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789601440.363191:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+15:9688:x1876532858476032:12345-192.168.201.30@tcp:36:rm.0 Request processed in 1668us (2010us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789601440.363201:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 31 00010000:00010000:2.0:1789601440.366917:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac14e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.366942:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac14e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.366953:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac14e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.366961:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601440.366967:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac14e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.366975:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac14e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.366997:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91edd8a67b00) 00010000:00010000:2.0:1789601440.367000:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601440.367006:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac14e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601440.367013:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac14e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601440.713213:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601440.713275:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880530048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601440.713405:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601440.713824:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880530048 00000100:00100000:2.0:1789601440.713851:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880530048 00000100:00100000:2.0:1789601440.713936:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789601440.713948:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880530048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601440.714015:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601440.714082:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880530048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601440.714090:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1789601440.715054:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789601440.715110:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf8a0f800 x1876532880530048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601440.715138:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880530048:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789601440.781879:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601441.804919:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601442.763511:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880530176:0@lo:400:kworker.0 00000100:00100000:0.0:1789601442.763618:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601442.763730:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880530176 00000100:00100000:1.0:1789601442.763741:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880530176 00000100:00100000:1.0:1789601442.763808:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789601442.763818:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3319:x1876532880530176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601442.764008:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880530304:0@lo:400:kworker.0 00000100:00100000:2.0:1789601442.764058:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601442.764059:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3319:x1876532880530176:12345-0@lo:400:kworker.0 Request processed in 238us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601442.764070:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789601442.764155:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880530176:0@lo:400:kworker.0 00000100:00100000:2.0:1789601442.764257:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880530304 00000100:00100000:2.0:1789601442.764271:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880530304 00000100:00100000:2.0:1789601442.764324:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789601442.764333:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880530304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601442.764354:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880530432:0@lo:400:kworker.0 00000100:00100000:2.0:1789601442.764384:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880530304:12345-0@lo:400:kworker.0 Request processed in 52us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601442.764392:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789601442.764397:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601442.764516:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601442.764524:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880530560:0@lo:400:kworker.0 00000100:00100000:1.0:1789601442.764555:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601442.764590:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880530560 00000100:00100000:1.0:1789601442.764594:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880530560 00000100:00100000:1.0:1789601442.764636:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789601442.764644:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880530560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601442.764682:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880530560:12345-0@lo:400:kworker.0 Request processed in 38us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601442.764688:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1789601442.764707:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601442.764717:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880530432 00010000:00080000:1.0:1789601442.764737:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf8b1d180 x1876532880530560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601442.764751:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880530560:0@lo:400:kworker.0 00000100:00100000:2.0:1789601442.764775:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880530432 00000100:00100000:2.0:1789601442.764818:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789601442.764826:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880530432:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789601442.764877:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601442.764914:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880530432:12345-0@lo:400:kworker.0 Request processed in 87us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601442.764920:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789601442.764943:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880530432:0@lo:400:kworker.0 00000100:00100000:2.0:1789601442.764961:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880530304:0@lo:400:kworker.0 00000100:00100000:0.0:1789601442.765766:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876532880530688:0@lo:400:kworker.0 00000100:00100000:0.0:1789601442.765823:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601442.765980:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880530816:0@lo:400:kworker.0 00000100:00100000:2.0:1789601442.766018:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601442.766100:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880530816 00000100:00100000:3.0:1789601442.766108:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880530816 00000100:00100000:3.0:1789601442.766166:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789601442.766175:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880530816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601442.766259:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880530816:12345-0@lo:400:kworker.0 Request processed in 85us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601442.766267:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1789601442.766367:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf8b1c000 x1876532880530816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789601442.766382:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601442.766391:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880530816:0@lo:400:kworker.0 00000100:00100000:1.0:1789601442.767026:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880530688 00000100:00100000:1.0:1789601442.767034:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880530688 00000100:00100000:1.0:1789601442.767116:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789601442.767124:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876532880530688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601442.767202:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876532880530688:12345-0@lo:400:kworker.0 Request processed in 69us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601442.767209:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789601442.767277:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876532880530688:0@lo:400:kworker.0 00000100:00080000:3.0:1789601442.767332:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789601442.831251:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789601443.273682:0:8064:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 313311839704ns, next at 314311836066ns, rc = 0 00000100:00100000:0.0:1789601443.273721:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601443.273749:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edfff51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880530944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601443.273870:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601443.273967:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880530944 00000100:00100000:0.0:1789601443.273978:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880530944 00000100:00100000:0.0:1789601443.274040:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789601443.274051:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880530944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789601443.274113:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789601443.274180:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880530944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601443.274201:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1789601443.274269:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edfff51500 x1876532880530944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601443.274291:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edfff51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880530944:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789601443.850034:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601444.873145:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789601445.186077:0:11599:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:2.0:1789601445.340979:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601445.341016:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601445.341038:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601445.341058:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601445.341081:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858476416 00000100:00100000:2.0:1789601445.341091:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858476416 00000100:00100000:2.0:1789601445.341182:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:2.0:1789601445.341194:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2356:x1876532858476416:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601445.342576:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858476160 00000100:00100000:3.0:1789601445.342586:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858476160 00000100:00100000:3.0:1789601445.342638:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 252 00000100:00100000:3.0:1789601445.342647:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2356:x1876532858476160:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601445.342711:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2356:x1876532858476160:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 66us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601445.342719:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 252 00000100:00100000:2.0:1789601445.343375:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8de8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2356:x1876532858476416:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 2181us (2355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601445.343385:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:2.0:1789601445.343414:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858476288 00000100:00100000:2.0:1789601445.343419:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858476288 00000100:00080000:3.0:1789601445.345516:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601445.345529:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601445.345552:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858476544 00000100:00100000:3.0:1789601445.345567:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858476544 00000100:00100000:3.0:1789601445.345655:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 114 00000100:00100000:3.0:1789601445.345669:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:2356:x1876532858476288:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601445.345788:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8310e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:2356:x1876532858476288:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 122us (4745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601445.345797:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 114 00000100:00100000:3.0:1789601445.345823:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00100000:3.0:1789601445.345833:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858476544:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601445.345911:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8313b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858476544:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 80us (4849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601445.345917:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00080000:3.0:1789601445.345953:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789601445.429734:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1789601445.429765:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967300 is committed 00000001:00080000:1.0:1789601445.429774:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967303 is committed 00000001:00080000:1.0:1789601445.429780:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1789601445.429792:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1789601445.430488:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edfff51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880531072:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789601445.430554:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601445.430626:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880531072 00000100:00100000:0.0:1789601445.430633:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880531072 00000100:00100000:0.0:1789601445.430689:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789601445.430698:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880531072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789601445.430725:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1789601445.430760:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aab26a1, atime: 0x6aab26a1, ctime: 0x6aab26a1, blocks: 0x1 00010000:00010000:0.0:1789601445.430768:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9fd42da/0xf3d6e402158ac15c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601445.430784:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=315s v=(0 0) 00010000:00010000:0.0:1789601445.430788:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601445.430795:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9fd42da/0xf3d6e402158ac15c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601445.430811:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9fd42da/0xf3d6e402158ac15c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601445.430853:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9fd42da/0xf3d6e402158ac15c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601445.430862:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9fd42da/0xf3d6e402158ac15c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601445.430879:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789601445.431453:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1876532880531072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 755us (897us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789601445.431461:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789601445.431487:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789601445.431500:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601445.431506:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9fd42da/0xf3d6e402158ac15c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601445.431514:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924a00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601445.431520:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9fd42da/0xf3d6e402158ac15c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601445.431529:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9fd42da/0xf3d6e402158ac15c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601445.431544:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9fd42da/0xf3d6e402158ac15c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601445.431564:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9fd42da/0xf3d6e402158ac15c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601445.431584:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601445.431585:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601445.431587:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789601445.431621:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91edfff51500/2, rc 0, transno 4294967300 00000100:00100000:0.0:1789601445.431628:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edfff51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880531072:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789601445.833566:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880531200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601445.833670:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601445.833786:0:10225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880531200 00000100:00100000:3.0:1789601445.833797:0:10225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880531200 00000100:00100000:3.0:1789601445.833893:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789601445.833906:0:10225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880531200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789601445.833952:0:10225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789601445.834288:0:10225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880531200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 384us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601445.834296:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789601445.834322:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789601445.834513:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf8a0c700 x1876532880531200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601445.834535:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880531200:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789601445.902302:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789601446.181269:0:11648:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffefb132e10 20000000:00000080:2.0:1789601446.181287:0:11648:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91edc7035400 uarg=0000000000000000 20000000:01000000:2.0:1789601446.181325:0:11648:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789601446.181332:0:11648:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789601446.181337:0:11648:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789601446.184757:0:11649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789601446.185171:0:11648:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1789601446.197784:0:11648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1789601446.198157:0:11648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1789601446.198231:0:11648:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1789601446.198250:0:11648:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789601446.199211:0:11648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158ac163 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.199230:0:11648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc0030600/0xf3d6e402158ac005 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158abffe expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.199238:0:11648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc29c5e00/0xf3d6e402158ac013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ac00c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.199246:0:11648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc29c5800/0xf3d6e402158ac021 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ac01a expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.199341:0:11648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc29c5c00/0xf3d6e402158ac028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fd3 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.199349:0:11648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edffadc400/0xf3d6e402158ac02f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fda expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.199358:0:11648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158ac163 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.200249:0:11648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edffadc400/0xf3d6e402158ac02f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fda expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.200343:0:11648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91edffadc400/0xf3d6e402158ac02f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fda expref: 12 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601446.200361:0:11648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1876532880531328:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601446.200757:0:11648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc29c5c00/0xf3d6e402158ac028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fd3 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.200767:0:11648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91edc29c5c00/0xf3d6e402158ac028 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fd3 expref: 12 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601446.200776:0:11648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1876532880531456:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601446.200809:0:11648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc29c5800/0xf3d6e402158ac021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158ac01a expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.200817:0:11648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edc29c5800/0xf3d6e402158ac021 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158ac01a expref: 18 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601446.201124:0:11648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1876532880531584:0@lo:104: 00000100:00100000:1.0:1789601446.201179:0:11648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789601446.201280:0:11648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc29c5e00/0xf3d6e402158ac013 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158ac00c expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.201289:0:11648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edc29c5e00/0xf3d6e402158ac013 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158ac00c expref: 18 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601446.201297:0:11648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1876532880531712:0@lo:104: 00000100:00100000:1.0:1789601446.201318:0:11648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789601446.201474:0:11648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc0030600/0xf3d6e402158ac005 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158abffe expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.201482:0:11648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91edc0030600/0xf3d6e402158ac005 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158abffe expref: 18 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601446.201490:0:11648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1876532880531840:0@lo:104: 00000100:00100000:1.0:1789601446.201527:0:11648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601446.201776:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880531584 00000100:00100000:2.0:1789601446.201785:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880531584 00000100:00100000:2.0:1789601446.201983:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880531712 00000100:00100000:2.0:1789601446.201987:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880531712 00000100:00100000:2.0:1789601446.202005:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789601446.202025:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+4:11648:x1876532880531584:12345-0@lo:104: 00010000:00010000:2.0:1789601446.202038:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ac01a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158ac021 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601446.202100:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789601446.202105:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+4:11648:x1876532880531584:12345-0@lo:104: Request processed in 84us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601446.202112:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789601446.202142:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789601446.202149:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:11648:x1876532880531712:12345-0@lo:104: 00010000:00010000:2.0:1789601446.202156:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc29c4a00/0xf3d6e402158ac00c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158ac013 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601446.202190:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789601446.202195:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:11648:x1876532880531712:12345-0@lo:104: Request processed in 48us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601446.202201:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789601446.202232:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789601446.202238:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ac01a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158ac021 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601446.202245:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4e00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:2.0:1789601446.202250:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ac01a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158ac021 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601446.202442:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ac01a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158ac021 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601446.202451:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ac01a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158ac021 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601446.202463:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789601446.202493:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ac01a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ac021 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601446.202500:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601446.202627:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ac01a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ac021 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601446.202636:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ac01a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ac021 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601446.202650:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601446.202653:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc29c4a00/0xf3d6e402158ac00c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158ac013 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601446.202722:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4a00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:2.0:1789601446.202727:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c4a00/0xf3d6e402158ac00c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158ac013 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601446.202735:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc29c4a00/0xf3d6e402158ac00c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158ac013 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601446.202743:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c4a00/0xf3d6e402158ac00c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158ac013 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601446.202749:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789601446.202763:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc29c4a00/0xf3d6e402158ac00c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ac013 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601446.202769:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601446.202790:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc29c4a00/0xf3d6e402158ac00c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ac013 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601446.202797:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc29c4a00/0xf3d6e402158ac00c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ac013 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601446.202807:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601446.202809:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601446.202811:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601446.203058:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880531968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601446.203217:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601446.203282:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880531968 00000100:00100000:2.0:1789601446.203288:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880531968 00010000:00010000:2.0:1789601446.203310:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc29c5800/0xf3d6e402158ac021 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158ac01a expref: 19 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601446.203338:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789601446.203348:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8313480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880531968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789601446.203360:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601446.203366:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc29c5800/0xf3d6e402158ac021 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158ac01a expref: 19 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601446.203389:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc29c5800/0xf3d6e402158ac021 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158ac01a expref: 19 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601446.203407:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601446.203453:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8313480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880531968:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601446.203460:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789601446.203533:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789601446.203540:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880531968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601446.203565:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880531840 00000100:00100000:2.0:1789601446.203572:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880531840 00000100:00100000:2.0:1789601446.203614:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789601446.203623:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8080c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:11648:x1876532880531840:12345-0@lo:104: 00010000:00010000:2.0:1789601446.203634:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158abffe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158ac005 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601446.203688:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789601446.203693:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8080c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+3:11648:x1876532880531840:12345-0@lo:104: Request processed in 73us (2166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601446.203699:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1789601446.204885:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601446.204897:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158abffe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158ac005 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601446.204907:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadde00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:3.0:1789601446.204911:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158abffe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158ac005 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601446.204920:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158abffe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158ac005 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601446.204926:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158abffe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158ac005 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601446.204930:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789601446.204986:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158abffe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ac005 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601446.205016:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789601446.205033:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158abffe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ac005 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601446.205039:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158abffe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ac005 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601446.205060:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601446.205061:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601446.205062:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601446.206691:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601446.206724:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880532096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601446.206802:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601446.207099:0:11648:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc4668240 going to sleep for 11 seconds 00010000:00010000:1.0:1789601446.207141:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc29c5800/0xf3d6e402158ac021 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158ac01a expref: 18 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601446.207160:0:11648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1876532880531584:0@lo:104: 00000100:00100000:1.0:1789601446.207172:0:11648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1876532880531712:0@lo:104: 00000100:00100000:1.0:1789601446.207178:0:11648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1876532880531840:0@lo:104: 00000100:00100000:0.0:1789601446.207281:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601446.207288:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880532224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601446.207321:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601446.211209:0:11648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1876532880531328:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789601446.211228:0:11648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11648:1876532880531456:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601446.211283:0:11648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158ac163 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601446.211365:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880532096 00000100:00100000:2.0:1789601446.211448:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880532096 00010000:00010000:2.0:1789601446.211487:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc29c5e00/0xf3d6e402158ac013 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158ac00c expref: 18 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601446.211670:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880532224 00000100:00100000:2.0:1789601446.211675:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880532224 00010000:00010000:2.0:1789601446.211692:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc0030600/0xf3d6e402158ac005 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abffe expref: 19 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601446.212055:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789601446.212066:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880532096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789601446.212083:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601446.212089:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc29c5e00/0xf3d6e402158ac013 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158ac00c expref: 19 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.212101:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc29c5e00/0xf3d6e402158ac013 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158ac00c expref: 19 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.212118:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc29c5e00/0xf3d6e402158ac013 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158ac00c expref: 19 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.212144:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601446.212210:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff53800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:3317:x1876532880532096:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (5408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601446.212218:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789601446.212236:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789601446.212242:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede51e3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:3317:x1876532880532224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789601446.212250:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601446.212254:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc0030600/0xf3d6e402158ac005 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158abffe expref: 17 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.212262:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc0030600/0xf3d6e402158ac005 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158abffe expref: 17 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.212272:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc0030600/0xf3d6e402158ac005 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158abffe expref: 17 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.212290:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601446.212315:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede51e3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:3317:x1876532880532224:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (4994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601446.212321:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789601446.212471:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880532224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601446.212481:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880532096:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601446.217737:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601446.217804:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601446.217806:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858476800 00000100:00100000:1.0:1789601446.217833:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858476800 00000100:00100000:0.0:1789601446.217922:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858476672 00000100:00100000:0.0:1789601446.217942:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858476672 00010000:00010000:0.0:1789601446.218043:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edffadc400/0xf3d6e402158ac02f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fda expref: 13 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601446.218083:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:0.0:1789601446.218092:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8312680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2357:x1876532858476672:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601446.218106:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601446.218111:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edffadc400/0xf3d6e402158ac02f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fda expref: 13 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601446.218123:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edffadc400/0xf3d6e402158ac02f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fda expref: 13 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601446.218151:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edffadc400/0xf3d6e402158ac02f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fda expref: 13 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601446.218166:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601446.218220:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8312680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:2357:x1876532858476672:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 130us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601446.218227:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00010000:00010000:1.0:1789601446.218430:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc29c5c00/0xf3d6e402158ac028 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fd3 expref: 12 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601446.218459:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:1.0:1789601446.218466:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8312300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:2357:x1876532858476800:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601446.218474:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601446.218478:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc29c5c00/0xf3d6e402158ac028 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fd3 expref: 12 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.218487:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc29c5c00/0xf3d6e402158ac028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fd3 expref: 12 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.218498:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc29c5c00/0xf3d6e402158ac028 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fd3 expref: 12 pid: 5830 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.218510:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158ac163 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.220799:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158ac163 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.220932:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158ac163 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.221025:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158ac163 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.221033:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158ac163 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.221040:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158ac163 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.221047:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88a00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601446.221051:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158ac163 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.221060:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158ac163 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.221088:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158ac163 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601446.221101:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601446.221178:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8312300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+11:2357:x1876532858476800:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 2709us (3452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601446.221190:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 34 00010000:00010000:2.0:1789601446.230113:0:11648:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158ac163 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601446.230148:0:11648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158ac163 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601446.230156:0:11648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc3b88a00/0xf3d6e402158ac163 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601446.931742:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789601447.369823:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789601447.369832:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91edc7b4a800 from 7 10000000:01000000:1.0:1789601447.369860:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789601447.369930:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ac16a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601447.369945:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ac16a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601447.369976:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ac16a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601447.370011:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880532352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789601447.370107:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601447.370177:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604600 going to sleep for 11 seconds 00000100:00100000:1.0:1789601447.370202:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880532352 00000100:00100000:1.0:1789601447.370210:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880532352 00000100:00100000:1.0:1789601447.370265:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789601447.370275:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:5834:x1876532880532352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601447.370291:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601447.370306:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc3b88200/0xf3d6e402158ac171 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158ac16a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601447.370335:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc3b88200/0xf3d6e402158ac171 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158ac16a expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601447.370347:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc3b88200/0xf3d6e402158ac171 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ac16a expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601447.370356:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88200, rc 0) 00000100:00100000:1.0:1789601447.370399:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2266050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880532352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601447.370406:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789601447.370455:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880532352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601447.370473:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ac16a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac171 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601447.370489:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ac16a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ac171 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601447.370567:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880532480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601447.375079:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601447.375159:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604600 going to sleep for 11 seconds 00000100:00100000:3.0:1789601447.378608:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880532480 00000100:00100000:3.0:1789601447.378634:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880532480 00000100:00100000:3.0:1789601447.378731:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789601447.378752:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880532480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601447.379499:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880532480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 756us (4430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601447.379510:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789601447.381496:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880532480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601447.382958:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8311180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880532608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601447.383082:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601447.383162:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8a71780 going to sleep for 11 seconds 00000100:00100000:3.0:1789601447.383286:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880532608 00000100:00100000:3.0:1789601447.383297:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880532608 00000100:00100000:3.0:1789601447.383366:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789601447.383377:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880532608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601447.383626:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880532608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601447.383635:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789601447.384251:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8311180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880532608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601447.387467:0:11662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:11662:1876532880532736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601447.387587:0:11662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601447.387709:0:11662:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604840 going to sleep for 11 seconds 00000100:00100000:0.0:1789601447.388420:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880532736 00000100:00100000:0.0:1789601447.388433:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880532736 00000100:00100000:0.0:1789601447.388538:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789601447.388550:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:11662:x1876532880532736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601447.389431:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8a89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:11662:x1876532880532736:12345-0@lo:502:llog_process_th.0 Request processed in 879us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601447.389442:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789601447.389582:0:11662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:11662:1876532880532736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601447.389625:0:11662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601447.389638:0:11662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601447.389641:0:11662:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789601447.389663:0:11662:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91edc7b4a800 00000020:00000080:1.0:1789601447.389666:0:11662:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789601447.390652:0:11662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:11662:1876532880532864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601447.390734:0:11662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601447.391588:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880532864 00000100:00100000:3.0:1789601447.391600:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880532864 00000100:00100000:3.0:1789601447.391678:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789601447.391688:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:11662:x1876532880532864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601447.398432:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8a8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:11662:x1876532880532864:12345-0@lo:502:llog_process_th.0 Request processed in 6731us (7684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601447.398452:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789601447.399004:0:11662:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604840 going to sleep for 11 seconds 00000100:00100000:0.0:1789601447.399398:0:11662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:11662:1876532880532864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789601447.399447:0:11662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601447.399457:0:11662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601447.399460:0:11662:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789601447.399466:0:11662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789601447.400895:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789601447.400930:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789601447.400946:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ac16a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac171 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601447.400962:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ac16a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac171 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601447.400975:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789601447.400979:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91edc825a800 from 7 10000000:01000000:3.0:1789601447.400982:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789601447.401036:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158ac178 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601447.401045:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158ac178 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601447.404430:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158ac178 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601447.404493:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880532992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789601447.404595:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601447.404892:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880532992 00000100:00100000:1.0:1789601447.404904:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880532992 00000100:00100000:1.0:1789601447.405005:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789601447.405017:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:5834:x1876532880532992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601447.405037:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601447.405069:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc3b89600/0xf3d6e402158ac17f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158ac178 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601447.405103:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc3b89600/0xf3d6e402158ac17f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158ac178 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601447.405145:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc3b89600/0xf3d6e402158ac17f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ac178 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601447.405156:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b89600, rc 0) 00000100:00100000:3.0:1789601447.406686:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc211ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789601447.407027:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1609050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880532992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2008us (2426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601447.407038:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789601447.407410:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880532992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601447.407461:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158ac178 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac17f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601447.407477:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158ac178 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ac17f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601447.407578:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880533120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601447.407623:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601447.407661:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc211ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789601447.407681:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880533120 00000100:00100000:3.0:1789601447.407687:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880533120 00000100:00100000:3.0:1789601447.407729:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789601447.407738:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880533120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601447.413321:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880533120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601447.413407:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880533248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601447.413490:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601447.413539:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc6049c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601447.413740:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880533248 00000100:00100000:0.0:1789601447.413750:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880533248 00000100:00100000:0.0:1789601447.413813:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789601447.413823:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880533248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601447.414060:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1608050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880533248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601447.414070:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789601447.416726:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880533120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5052us (5166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601447.416748:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789601447.417144:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880533248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601447.427894:0:11665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:11665:1876532880533376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601447.428020:0:11665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601447.428246:0:11665:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc6046c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601447.428345:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880533376 00000100:00100000:2.0:1789601447.428357:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880533376 00000100:00100000:2.0:1789601447.428422:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789601447.428434:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:11665:x1876532880533376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601447.429026:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:11665:x1876532880533376:12345-0@lo:502:llog_process_th.0 Request processed in 591us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601447.429035:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789601447.429571:0:11665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:11665:1876532880533376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789601447.429620:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601447.429633:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601447.429636:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789601447.429649:0:11665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91edc825a800 00000020:00000080:3.0:1789601447.429652:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789601447.429776:0:11665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:11665:1876532880533504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601447.429880:0:11665:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601447.429922:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880533504 00000100:00100000:3.0:1789601447.429927:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880533504 00000100:00100000:3.0:1789601447.429969:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789601447.429988:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:11665:x1876532880533504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601447.431919:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1609c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:11665:x1876532880533504:12345-0@lo:502:llog_process_th.0 Request processed in 1922us (2027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601447.431937:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789601447.432020:0:11665:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc211e900 going to sleep for 11 seconds 00000100:00100000:3.0:1789601447.432049:0:11665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:11665:1876532880533504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789601447.432281:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601447.432292:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601447.432295:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789601447.432305:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789601447.433291:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789601447.433329:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789601447.433343:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158ac178 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac17f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601447.433358:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158ac178 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac17f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601447.433372:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789601447.433375:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91edd1466000 from 7 10000000:01000000:1.0:1789601447.433390:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789601447.433433:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158ac186 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601447.433442:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158ac186 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601447.433452:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158ac186 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601447.433478:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880533632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789601447.433552:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601447.433598:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc6040c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601447.433831:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880533632 00000100:00100000:3.0:1789601447.434261:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880533632 00000100:00100000:3.0:1789601447.434319:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789601447.434330:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:5834:x1876532880533632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601447.434345:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601447.434362:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edffadd400/0xf3d6e402158ac18d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158ac186 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601447.434389:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edffadd400/0xf3d6e402158ac18d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158ac186 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601447.434401:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edffadd400/0xf3d6e402158ac18d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ac186 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601447.434410:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadd400, rc 0) 00000100:00100000:3.0:1789601447.434463:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880533632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601447.434470:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789601447.435259:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880533632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601447.435282:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158ac186 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac18d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601447.435293:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158ac186 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ac18d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601447.435371:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880533760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601447.435426:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601447.435460:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc6040c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601447.436187:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880533760 00000100:00100000:3.0:1789601447.436197:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880533760 00000100:00100000:3.0:1789601447.436237:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789601447.436246:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880533760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601447.436580:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880533760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 335us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601447.436589:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789601447.437206:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880533760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601447.437268:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880533888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601447.437333:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601447.437375:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc6040c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601447.437392:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880533888 00000100:00100000:1.0:1789601447.437405:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880533888 00000100:00100000:1.0:1789601447.437449:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789601447.437456:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880533888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601447.437647:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1608450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:5834:x1876532880533888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601447.437655:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789601447.437693:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:435644e3-9e9f-44ed-9cfe-21987eda72e5:5834:1876532880533888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601447.442999:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8311180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:11666:1876532880534016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601447.443148:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601447.443344:0:11666:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8a71f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601447.443443:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880534016 00000100:00100000:1.0:1789601447.443454:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880534016 00000100:00100000:1.0:1789601447.443515:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789601447.443527:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:11666:x1876532880534016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601447.444304:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:11666:x1876532880534016:12345-0@lo:502:llog_process_th.0 Request processed in 776us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601447.444315:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789601447.444468:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8311180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:11666:1876532880534016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789601447.444514:0:11666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601447.444527:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601447.444530:0:11666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789601447.444543:0:11666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91edd1466000 00000020:00000080:3.0:1789601447.444546:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789601447.444661:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:11666:1876532880534144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601447.444709:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601447.444867:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880534144 00000100:00100000:3.0:1789601447.444873:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880534144 00000100:00100000:3.0:1789601447.444907:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789601447.444915:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:11666:x1876532880534144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601447.446308:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:11666:x1876532880534144:12345-0@lo:502:llog_process_th.0 Request processed in 1384us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601447.446322:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789601447.446416:0:11666:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc211e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789601447.446443:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:435644e3-9e9f-44ed-9cfe-21987eda72e5:11666:1876532880534144:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789601447.446479:0:11666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601447.446487:0:11666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601447.446495:0:11666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789601447.446505:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789601447.449344:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789601447.449387:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789601447.449401:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158ac186 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac18d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601447.449417:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158ac186 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac18d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789601447.471824:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789601447.512640:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601447.512925:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858476928 00000100:00100000:2.0:1789601447.512941:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858476928 00000100:00100000:2.0:1789601447.513006:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 268 00000100:00100000:2.0:1789601447.513019:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+11:5599:x1876532858476928:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601447.513041:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601447.513077:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edd8d8ca00/0xf3d6e402158ac194 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061027 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601447.513142:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edd8d8ca00/0xf3d6e402158ac194 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061027 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601447.513157:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edd8d8ca00/0xf3d6e402158ac194 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061027 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601447.513170:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8ca00, rc 0) 00000100:00100000:2.0:1789601447.513256:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:5599:x1876532858476928:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 240us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601447.513264:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 268 00000100:00100000:3.0:1789601447.530155:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601447.530314:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858477056 00000100:00100000:0.0:1789601447.530328:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858477056 00000100:00100000:0.0:1789601447.530398:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 269 00000100:00100000:0.0:1789601447.530412:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:5599:x1876532858477056:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601447.530829:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1609850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:5599:x1876532858477056:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 420us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601447.530875:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 269 00000100:00100000:3.0:1789601447.546224:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601447.546357:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858477184 00000100:00100000:0.0:1789601447.546373:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858477184 00000100:00100000:0.0:1789601447.546451:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 270 00000100:00100000:0.0:1789601447.546466:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:5599:x1876532858477184:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601447.546805:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:5599:x1876532858477184:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 342us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601447.546815:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 270 00000100:00100000:3.0:1789601447.565324:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601447.565429:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858477312 00000100:00100000:0.0:1789601447.565444:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858477312 00000100:00100000:0.0:1789601447.565508:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 271 00000100:00100000:0.0:1789601447.565519:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:9959:x1876532858477312:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789601447.565869:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1609450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:9959:x1876532858477312:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 352us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601447.565876:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 271 00000100:00100000:0.0:1789601447.588076:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601447.589551:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858477440 00000100:00100000:1.0:1789601447.589571:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858477440 00000100:00100000:1.0:1789601447.589660:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 272 00000100:00100000:1.0:1789601447.589673:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd160a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:9959:x1876532858477440:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789601447.590305:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd160a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:9959:x1876532858477440:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 633us (2241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601447.590325:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 272 00000100:00100000:3.0:1789601447.602007:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601447.602180:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858477568 00000100:00100000:1.0:1789601447.602195:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858477568 00000100:00100000:1.0:1789601447.602276:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 273 00000100:00100000:1.0:1789601447.602288:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd1608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:5599:x1876532858477568:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601447.602319:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601447.602342:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc3b89a00/0xf3d6e402158ac19b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f506102e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601447.602379:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc3b89a00/0xf3d6e402158ac19b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506102e expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601447.602391:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc3b89a00/0xf3d6e402158ac19b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506102e expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601447.602401:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b89a00, rc 0) 00000100:00100000:1.0:1789601447.602666:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd1608850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:5599:x1876532858477568:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 379us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601447.602674:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 273 00000100:00100000:0.0:1789601447.613067:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601447.613206:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858477696 00000100:00100000:2.0:1789601447.613221:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858477696 00000100:00100000:2.0:1789601447.613297:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 274 00000100:00100000:2.0:1789601447.613311:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:5599:x1876532858477696:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601447.613722:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0064450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:5599:x1876532858477696:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 412us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601447.613732:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 274 00000100:00100000:0.0:1789601447.616957:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601447.617070:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858477824 00000100:00100000:1.0:1789601447.617085:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858477824 00000100:00100000:1.0:1789601447.617162:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 275 00000100:00100000:1.0:1789601447.617174:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:5599:x1876532858477824:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601447.617471:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0066c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:5599:x1876532858477824:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 299us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601447.617481:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 275 00000100:00100000:3.0:1789601447.622236:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601447.622333:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858477952 00000100:00100000:0.0:1789601447.622347:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858477952 00000100:00100000:0.0:1789601447.622413:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 276 00000100:00100000:0.0:1789601447.622426:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:9962:x1876532858477952:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789601447.622895:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0067450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:9962:x1876532858477952:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 470us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601447.622905:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 276 00000100:00100000:0.0:1789601447.629380:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601447.629564:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858478080 00000100:00100000:2.0:1789601447.629578:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858478080 00000100:00100000:2.0:1789601447.629708:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 277 00000100:00100000:2.0:1789601447.629722:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:9962:x1876532858478080:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789601447.630820:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0066050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:9962:x1876532858478080:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 1093us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601447.630864:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 277 00000100:00100000:2.0:1789601447.881811:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880534656:0@lo:400:kworker.0 00000100:00100000:2.0:1789601447.882021:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601447.882152:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789601447.882159:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880534528:0@lo:400:kworker.0 00000100:00100000:2.0:1789601447.882212:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601447.882634:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880534400:0@lo:400:kworker.0 00000100:00100000:3.0:1789601447.882671:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601447.882705:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789601447.882712:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880534272:0@lo:400:kworker.0 00000100:00100000:3.0:1789601447.882733:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601447.882759:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880534784:0@lo:400:kworker.0 00000100:00100000:1.0:1789601447.882996:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880534656 00000100:00100000:1.0:1789601447.883006:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880534656 00000100:00100000:1.0:1789601447.883077:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880534400 00000100:00100000:1.0:1789601447.883080:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880534400 00000100:00100000:1.0:1789601447.883096:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880534272 00000100:00100000:1.0:1789601447.883098:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880534272 00000100:00100000:1.0:1789601447.883131:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789601447.883142:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880534656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601447.883214:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880534656:12345-0@lo:400:kworker.0 Request processed in 74us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601447.883222:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789601447.883243:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789601447.883249:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880534400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601447.883277:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880534400:12345-0@lo:400:kworker.0 Request processed in 28us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601447.883283:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789601447.883294:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789601447.883300:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880534272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601447.883326:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880534272:12345-0@lo:400:kworker.0 Request processed in 26us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601447.883332:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789601447.883489:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789601447.883669:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601447.884057:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8313800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880534400:0@lo:400:kworker.0 00000100:00100000:0.0:1789601447.884191:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880534528 00000100:00100000:0.0:1789601447.884198:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880534528 00000100:00100000:0.0:1789601447.884243:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880534784 00000100:00100000:0.0:1789601447.884246:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880534784 00000100:00100000:0.0:1789601447.884263:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789601447.884272:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880534528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601447.884357:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880534656:0@lo:400:kworker.0 00000100:00080000:1.0:1789601447.884378:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601447.884396:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601447.884415:0:6676:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789601447.884424:0:6676:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1789601447.884448:0:6677:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789601447.884456:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789601447.884463:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1876532880534784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601447.884508:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8313480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880534272:0@lo:400:kworker.0 00000100:00100000:0.0:1789601447.891287:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880534528:12345-0@lo:400:kworker.0 Request processed in 7003us (9059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601447.891309:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1789601447.891593:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edc8311180 x1876532880534528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601447.891613:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8311180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880534528:0@lo:400:kworker.0 00000100:00100000:1.0:1789601447.896427:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1876532880534784:12345-0@lo:400:kworker.0 Request processed in 11952us (12925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601447.896445:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789601447.900239:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880534784:0@lo:400:kworker.0 00010000:00010000:0.0:1789601447.945543:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601448.394328:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edfff53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880534912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601448.394432:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601448.396771:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880534912 00000100:00100000:0.0:1789601448.396793:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880534912 00000100:00100000:0.0:1789601448.396933:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789601448.396947:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1876532880534912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789601448.397005:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789601448.397147:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1876532880534912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 204us (2714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601448.397155:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789601448.397243:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edfff53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880534912:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1789601448.523295:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789601448.969202:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601449.993303:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601450.459904:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601450.459951:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601450.461110:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858478336 00000100:00100000:0.0:1789601450.461126:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858478336 00000100:00100000:0.0:1789601450.461217:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 119 00000100:00100000:0.0:1789601450.461230:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2359:x1876532858478336:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601450.461277:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858478208 00000100:00100000:3.0:1789601450.461284:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858478208 00000100:00100000:3.0:1789601450.461323:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 278 00000100:00100000:3.0:1789601450.461332:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2358:x1876532858478208:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601450.461339:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2359:x1876532858478336:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 110us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601450.461349:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 119 00000100:00100000:3.0:1789601450.461372:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0065850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2358:x1876532858478208:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 40us (1484us total) trans 0 rc 0/0 00000100:00080000:0.0:1789601450.461384:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601450.461390:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 278 00000100:00100000:0.0:1789601450.461440:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601450.461467:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858478592 00000100:00100000:3.0:1789601450.461472:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858478592 00000100:00100000:3.0:1789601450.461509:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00100000:3.0:1789601450.461530:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85db4f7d-704a-4080-a137-b2930e072a8c+5:2359:x1876532858478592:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601450.461559:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85db4f7d-704a-4080-a137-b2930e072a8c+5:2359:x1876532858478592:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601450.461565:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00080000:3.0:1789601450.461582:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601450.461866:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601450.461900:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858478464 00000100:00100000:2.0:1789601450.461905:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858478464 00000100:00100000:2.0:1789601450.461943:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:2.0:1789601450.461951:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2358:x1876532858478464:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601450.461983:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2358:x1876532858478464:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601450.461990:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00080000:2.0:1789601450.462016:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1789601450.498830:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1789601450.957389:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789601450.957424:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880535040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601450.957525:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601450.957887:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880535040 00000100:00100000:3.0:1789601450.957900:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880535040 00000100:00100000:3.0:1789601450.958014:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789601450.958040:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880535040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789601450.958102:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789601450.958473:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7eded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880535040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 434us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601450.958483:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1789601450.958684:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789601450.958750:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf8a0d880 x1876532880535040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601450.958778:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880535040:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789601451.017200:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601452.041305:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601453.002870:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601453.003110:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880535296:0@lo:400:kworker.0 00000100:00100000:3.0:1789601453.003223:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601453.003309:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601453.003317:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880535424:0@lo:400:kworker.0 00000100:00100000:3.0:1789601453.003343:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601453.003390:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880535296 00000100:00100000:3.0:1789601453.003401:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880535296 00000100:00100000:3.0:1789601453.003468:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880535424 00000100:00100000:3.0:1789601453.003489:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880535424 00000100:00100000:3.0:1789601453.003526:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789601453.003535:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880535296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601453.003594:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880535296:12345-0@lo:400:kworker.0 Request processed in 59us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601453.003602:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789601453.003619:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789601453.003626:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880535424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601453.003653:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8311180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880535424:12345-0@lo:400:kworker.0 Request processed in 28us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601453.003659:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789601453.003716:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880535424:0@lo:400:kworker.0 00000100:00100000:3.0:1789601453.003727:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7edca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880535296:0@lo:400:kworker.0 00000100:00080000:3.0:1789601453.003786:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601453.004692:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601453.004714:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880535552:0@lo:400:kworker.0 00000100:00100000:0.0:1789601453.004792:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601453.005243:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880535552 00000100:00100000:3.0:1789601453.005253:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880535552 00000100:00100000:3.0:1789601453.005329:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789601453.005338:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880535552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601453.005398:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880535552:12345-0@lo:400:kworker.0 Request processed in 62us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601453.005418:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1789601453.006156:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789601453.006205:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf7edc700 x1876532880535552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601453.006246:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7edc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880535552:0@lo:400:kworker.0 00000100:00100000:1.0:1789601453.006452:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880535168:0@lo:400:kworker.0 00000100:00100000:1.0:1789601453.006513:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601453.006678:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880535168 00000100:00100000:0.0:1789601453.006698:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880535168 00000100:00100000:0.0:1789601453.006749:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789601453.006757:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880535168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601453.007106:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0064c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880535168:12345-0@lo:400:kworker.0 Request processed in 348us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601453.007113:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789601453.007269:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880535168:0@lo:400:kworker.0 00000100:00100000:2.0:1789601453.010856:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601453.010887:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880535808:0@lo:400:kworker.0 00000100:00100000:2.0:1789601453.011002:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601453.011097:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880535808 00000100:00100000:2.0:1789601453.011107:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880535808 00000100:00100000:2.0:1789601453.011563:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789601453.011576:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880535808:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789601453.011787:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601453.011884:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1789601453.011891:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91edfff51500, transno 4294967300 00000100:00100000:3.0:1789601453.011906:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7ede300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880535808:0@lo:400:kworker.0 00000100:00100000:2.0:1789601453.012040:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880535808:12345-0@lo:400:kworker.0 Request processed in 78us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601453.012053:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789601453.013441:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880535680:0@lo:400:kworker.0 00000100:00100000:0.0:1789601453.013527:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601453.013934:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880535680 00000100:00100000:3.0:1789601453.013955:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880535680 00000100:00100000:3.0:1789601453.014050:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789601453.014059:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880535680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601453.014140:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880535680:12345-0@lo:400:kworker.0 Request processed in 72us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601453.014147:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1789601453.014260:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601453.014299:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880535680:0@lo:400:kworker.0 00010000:00010000:3.0:1789601453.065290:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601453.513233:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601453.513265:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edfff50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880535936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601453.513360:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601453.513660:0:10225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880535936 00000100:00100000:2.0:1789601453.513679:0:10225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880535936 00000100:00100000:2.0:1789601453.513747:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789601453.513760:0:10225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880535936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601453.513806:0:10225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601453.513913:0:10225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880535936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601453.513921:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789601453.514178:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edfff50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880535936:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789601454.089444:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601455.119278:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601455.575288:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601455.575320:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601455.575354:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601455.575379:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601455.575549:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858478848 00000100:00100000:3.0:1789601455.575560:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858478848 00000100:00100000:3.0:1789601455.575628:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858479104 00000100:00100000:3.0:1789601455.575631:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858479104 00000100:00100000:3.0:1789601455.575661:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:3.0:1789601455.575670:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2359:x1876532858478848:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601455.575743:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2359:x1876532858478848:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 74us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601455.575750:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:3.0:1789601455.575765:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 125 00000100:00100000:3.0:1789601455.575771:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85db4f7d-704a-4080-a137-b2930e072a8c+5:2359:x1876532858479104:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601455.575794:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85db4f7d-704a-4080-a137-b2930e072a8c+5:2359:x1876532858479104:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601455.575800:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 125 00000100:00100000:3.0:1789601455.575820:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858478720 00000100:00100000:3.0:1789601455.575824:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858478720 00000100:00100000:3.0:1789601455.575869:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 280 00000100:00100000:3.0:1789601455.575876:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2359:x1876532858478720:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601455.575992:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0065450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2359:x1876532858478720:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 116us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601455.575999:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 280 00000100:00100000:3.0:1789601455.576027:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858478976 00000100:00100000:3.0:1789601455.576031:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858478976 00000100:00100000:3.0:1789601455.576061:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:3.0:1789601455.576068:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2359:x1876532858478976:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601455.576317:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2359:x1876532858478976:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 249us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601455.576324:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00080000:0.0:1789601455.578202:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601455.578213:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601456.073331:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880536064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601456.073430:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601456.073876:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880536064 00000100:00100000:3.0:1789601456.073888:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880536064 00000100:00100000:3.0:1789601456.073976:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789601456.073987:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880536064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789601456.074034:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789601456.074100:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880536064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601456.074108:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1789601456.074201:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf8a0dc00 x1876532880536064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601456.074224:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880536064:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789601456.074417:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789601456.138307:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601457.170876:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601458.122892:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880536320:0@lo:400:kworker.0 00000100:00100000:2.0:1789601458.122951:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880536192:0@lo:400:kworker.0 00000100:00100000:3.0:1789601458.122976:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601458.122999:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601458.123051:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880536832:0@lo:400:kworker.0 00000100:00100000:3.0:1789601458.123076:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601458.123108:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601458.123114:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880536448:0@lo:400:kworker.0 00000100:00100000:3.0:1789601458.123154:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601458.123188:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880536832 00000100:00100000:3.0:1789601458.123196:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880536832 00000100:00100000:3.0:1789601458.123254:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789601458.123262:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8313800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880536832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601458.123310:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8313800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880536832:12345-0@lo:400:kworker.0 Request processed in 48us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601458.123317:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789601458.123339:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880536320 00000100:00100000:3.0:1789601458.123343:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880536320 00000100:00100000:3.0:1789601458.123367:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880536448 00000100:00100000:3.0:1789601458.123370:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880536448 00000100:00100000:3.0:1789601458.123387:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789601458.123394:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880536320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601458.123426:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8313480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880536320:12345-0@lo:400:kworker.0 Request processed in 33us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601458.123432:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789601458.123444:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789601458.123449:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880536448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601458.123475:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880536448:12345-0@lo:400:kworker.0 Request processed in 27us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601458.123480:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1789601458.123496:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601458.123501:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601458.123534:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880536448:0@lo:400:kworker.0 00000100:00100000:3.0:1789601458.123544:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880536320:0@lo:400:kworker.0 00000100:00100000:3.0:1789601458.123564:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880536832:0@lo:400:kworker.0 00000100:00100000:3.0:1789601458.123601:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880536192 00000100:00100000:3.0:1789601458.123604:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880536192 00000100:00100000:3.0:1789601458.123625:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789601458.123630:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3318:x1876532880536192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601458.123656:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0066450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3318:x1876532880536192:12345-0@lo:400:kworker.0 Request processed in 26us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601458.123661:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789601458.124551:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880536576:0@lo:400:kworker.0 00000100:00100000:0.0:1789601458.124600:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601458.125133:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880536576 00000100:00100000:3.0:1789601458.125139:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880536576 00000100:00080000:0.0:1789601458.125193:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601458.125207:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789601458.125216:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880536576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601458.125271:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880536576:12345-0@lo:400:kworker.0 Request processed in 56us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601458.125278:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:0.0:1789601458.125304:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf8a0d880 x1876532880536576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601458.125319:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880536576:0@lo:400:kworker.0 00000100:00100000:2.0:1789601458.130342:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880536192:0@lo:400:kworker.0 00000100:00100000:2.0:1789601458.130361:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880536704:0@lo:400:kworker.0 00000100:00100000:2.0:1789601458.130425:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601458.131222:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880536704 00000100:00100000:3.0:1789601458.131233:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880536704 00000100:00100000:3.0:1789601458.131361:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789601458.131371:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880536704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601458.131439:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880536704:12345-0@lo:400:kworker.0 Request processed in 69us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601458.131446:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789601458.132418:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880536704:0@lo:400:kworker.0 00000100:00080000:0.0:1789601458.135606:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789601458.185251:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601458.633127:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880536960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601458.633213:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601458.633354:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880536960 00000100:00100000:0.0:1789601458.633362:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880536960 00000100:00100000:0.0:1789601458.633413:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789601458.633422:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880536960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789601458.633455:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789601458.633503:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880536960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601458.633509:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789601458.633821:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880536960:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1789601458.764312:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789601459.209088:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601460.234141:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601460.698356:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601460.698413:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601460.698511:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858479360 00000100:00100000:1.0:1789601460.698521:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858479360 00000100:00100000:1.0:1789601460.698601:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 129 00000100:00100000:1.0:1789601460.698613:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2359:x1876532858479360:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789601460.698689:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2359:x1876532858479360:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 78us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601460.698697:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 129 00000100:00100000:3.0:1789601460.698828:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858479232 00000100:00100000:3.0:1789601460.698833:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858479232 00000100:00100000:3.0:1789601460.698905:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 282 00000100:00100000:3.0:1789601460.698913:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2359:x1876532858479232:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601460.699043:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0064850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2359:x1876532858479232:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 132us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601460.699051:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 282 00000100:00080000:0.0:1789601460.699441:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601460.705811:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601460.706130:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858479488 00000100:00100000:0.0:1789601460.706141:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858479488 00000100:00100000:3.0:1789601460.706245:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601460.706302:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858479616 00000100:00100000:2.0:1789601460.706320:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858479616 00000100:00100000:0.0:1789601460.706443:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:0.0:1789601460.706455:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2355:x1876532858479488:12345-192.168.201.30@tcp:9:kworker.0 00000020:00000080:0.0:1789601460.706484:0:6679:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158ac0d7 00000100:00080000:0.0:1789601460.706494:0:6679:0:(import.c:65:import_set_state_nolock()) ffff91edf9db1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789601460.706531:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1789601460.706709:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601460.706898:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+2:2355:x1876532858479488:12345-192.168.201.30@tcp:9:kworker.0 Request processed in 445us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601460.706912:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:2.0:1789601460.708553:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 130 00000100:00100000:2.0:1789601460.708564:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85db4f7d-704a-4080-a137-b2930e072a8c+5:2358:x1876532858479616:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601460.708633:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85db4f7d-704a-4080-a137-b2930e072a8c+5:2358:x1876532858479616:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 72us (2388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601460.708639:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 130 00000100:00080000:1.0:1789601460.709314:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789601460.709322:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789601461.195286:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880537088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601461.195357:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601461.196100:0:10225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880537088 00000100:00100000:3.0:1789601461.196111:0:10225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880537088 00000100:00100000:3.0:1789601461.196198:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789601461.196209:0:10225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880537088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789601461.196248:0:10225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789601461.196308:0:10225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880537088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601461.196314:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1789601461.196355:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf8a0c380 x1876532880537088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601461.196375:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880537088:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789601461.196459:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789601461.258305:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601462.283121:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601463.241181:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601463.241214:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880537344:0@lo:400:kworker.0 00000100:00100000:2.0:1789601463.241319:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601463.241442:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880537344 00000100:00100000:2.0:1789601463.241454:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880537344 00000100:00100000:2.0:1789601463.241531:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789601463.241541:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880537344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601463.241604:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7ede300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880537344:12345-0@lo:400:kworker.0 Request processed in 63us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601463.241611:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789601463.241682:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880537344:0@lo:400:kworker.0 00000100:00100000:2.0:1789601463.241721:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880537472:0@lo:400:kworker.0 00000100:00100000:2.0:1789601463.241744:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601463.241775:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880537472 00000100:00100000:2.0:1789601463.241778:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880537472 00000100:00100000:2.0:1789601463.241877:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789601463.241884:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880537472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601463.241918:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880537472:12345-0@lo:400:kworker.0 Request processed in 35us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601463.241924:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:2.0:1789601463.241962:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601463.241982:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880537472:0@lo:400:kworker.0 00000100:00100000:2.0:1789601463.242023:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601463.242028:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880537856:0@lo:400:kworker.0 00000100:00100000:2.0:1789601463.242057:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601463.242093:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880537856 00000100:00100000:2.0:1789601463.242096:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880537856 00000100:00100000:2.0:1789601463.242131:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789601463.242137:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880537856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601463.242173:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880537856:12345-0@lo:400:kworker.0 Request processed in 36us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601463.242179:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1789601463.242198:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601463.242213:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880537856:0@lo:400:kworker.0 00000100:00100000:3.0:1789601463.242565:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880537600:0@lo:400:kworker.0 00000100:00100000:3.0:1789601463.242603:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601463.242635:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789601463.242642:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880537216:0@lo:400:kworker.0 00000100:00100000:3.0:1789601463.242688:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601463.242763:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880537728:0@lo:400:kworker.0 00000100:00100000:3.0:1789601463.242813:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601463.242936:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880537728 00000100:00100000:3.0:1789601463.242942:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880537728 00000100:00100000:3.0:1789601463.242997:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789601463.243005:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880537728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601463.243046:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880537728:12345-0@lo:400:kworker.0 Request processed in 43us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601463.243052:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:3.0:1789601463.243075:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601463.243098:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880537728:0@lo:400:kworker.0 00000100:00100000:2.0:1789601463.243869:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880537600 00000100:00100000:2.0:1789601463.243877:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880537600 00000100:00100000:2.0:1789601463.243935:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789601463.243944:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880537600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601463.244014:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880537600:12345-0@lo:400:kworker.0 Request processed in 72us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601463.244021:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1789601463.244486:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789601463.244529:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00c81500 x1876532880537600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601463.244544:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880537600:0@lo:400:kworker.0 00000100:00100000:1.0:1789601463.244691:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880537216 00000100:00100000:1.0:1789601463.244699:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880537216 00000100:00100000:1.0:1789601463.244747:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789601463.244756:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880537216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601463.245182:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0065050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880537216:12345-0@lo:400:kworker.0 Request processed in 426us (2491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601463.245189:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789601463.245329:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880537216:0@lo:400:kworker.0 00010000:00010000:0.0:1789601463.305519:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601463.753547:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601463.753580:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880537984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601463.753678:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601463.753912:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880537984 00000100:00100000:3.0:1789601463.753924:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880537984 00000100:00100000:3.0:1789601463.753995:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789601463.754007:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880537984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789601463.754055:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789601463.754123:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880537984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601463.754131:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789601463.754255:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880537984:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789601464.329179:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601465.359060:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601465.815356:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601465.815450:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601465.815492:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601465.815532:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858479744 00000100:00100000:3.0:1789601465.815550:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858479744 00000100:00100000:3.0:1789601465.815624:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 284 00000100:00100000:3.0:1789601465.815636:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2358:x1876532858479744:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601465.815748:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0066850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2358:x1876532858479744:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 114us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601465.815757:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 284 00000100:00100000:3.0:1789601465.815826:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858479872 00000100:00100000:3.0:1789601465.815831:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858479872 00000100:00100000:3.0:1789601465.815906:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858480000 00000100:00100000:3.0:1789601465.816189:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858480000 00000100:00100000:3.0:1789601465.816226:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 134 00000100:00100000:3.0:1789601465.816231:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2358:x1876532858479872:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601465.816265:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2358:x1876532858479872:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 35us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601465.816270:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 134 00000100:00100000:3.0:1789601465.816278:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 135 00000100:00100000:3.0:1789601465.816282:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85db4f7d-704a-4080-a137-b2930e072a8c+5:2358:x1876532858480000:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601465.816296:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85db4f7d-704a-4080-a137-b2930e072a8c+5:2358:x1876532858480000:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 14us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601465.816300:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 135 00000100:00080000:3.0:1789601465.816388:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1789601465.874082:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 00000020:00000080:2.0:1789601465.874096:0:7635:0:(genops.c:885:class_export_put()) final put ffff91edf9db7000/701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 00000020:00000080:1.0:1789601465.874242:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91edf9db7000/701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 for lustre-OST0001 00000020:00000080:1.0:1789601465.874313:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91edf9db1800 for lustre-OST0001 00000100:00100000:0.0:1789601466.313224:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601466.313258:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880538112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601466.313360:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601466.313569:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880538112 00000100:00100000:1.0:1789601466.313581:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880538112 00000100:00100000:1.0:1789601466.313679:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789601466.313691:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880538112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601466.313742:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601466.313813:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880538112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601466.313820:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1789601466.313903:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf8a0e680 x1876532880538112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601466.313926:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880538112:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789601466.314059:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789601466.378169:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601467.407667:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601468.363609:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880538368:0@lo:400:kworker.0 00000100:00100000:2.0:1789601468.363680:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601468.363751:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc7048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880538880:0@lo:400:kworker.0 00000100:00100000:2.0:1789601468.363775:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601468.363806:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601468.363812:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880538496:0@lo:400:kworker.0 00000100:00100000:2.0:1789601468.363830:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601468.363882:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880538880 00000100:00100000:2.0:1789601468.363891:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880538880 00000100:00100000:2.0:1789601468.363947:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789601468.363957:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc7049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880538880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601468.364016:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc7049f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880538880:12345-0@lo:400:kworker.0 Request processed in 60us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601468.364024:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1789601468.364045:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601468.364081:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc7048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880538880:0@lo:400:kworker.0 00000100:00100000:3.0:1789601468.364349:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880538624:0@lo:400:kworker.0 00000100:00100000:3.0:1789601468.364381:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601468.364423:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789601468.364429:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880538240:0@lo:400:kworker.0 00000100:00100000:3.0:1789601468.364455:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601468.364474:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc704bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880538752:0@lo:400:kworker.0 00000100:00100000:3.0:1789601468.364496:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601468.364524:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880538368 00000100:00100000:3.0:1789601468.364528:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880538368 00000100:00100000:3.0:1789601468.364553:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880538496 00000100:00100000:3.0:1789601468.364556:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880538496 00000100:00100000:3.0:1789601468.364574:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880538752 00000100:00100000:3.0:1789601468.364576:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880538752 00000100:00100000:3.0:1789601468.364590:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789601468.364596:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc704a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880538368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601468.364631:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc704a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880538368:12345-0@lo:400:kworker.0 Request processed in 35us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601468.364638:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789601468.364650:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789601468.364656:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc7049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880538496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601468.364681:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc7049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880538496:12345-0@lo:400:kworker.0 Request processed in 25us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601468.364686:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789601468.364697:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789601468.364702:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880538752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601468.364754:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880538752:12345-0@lo:400:kworker.0 Request processed in 52us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601468.364759:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789601468.364789:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc704bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880538752:0@lo:400:kworker.0 00000100:00100000:1.0:1789601468.366972:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880538240 00000100:00100000:1.0:1789601468.366983:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880538240 00000100:00100000:1.0:1789601468.367037:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789601468.367046:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880538240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601468.367133:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0064050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880538240:12345-0@lo:400:kworker.0 Request processed in 88us (2675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601468.367139:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789601468.367205:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880538240:0@lo:400:kworker.0 00000100:00100000:2.0:1789601468.369867:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880538624 00000100:00100000:2.0:1789601468.369881:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880538624 00000100:00100000:2.0:1789601468.369952:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789601468.369962:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880538624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601468.370067:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880538624:12345-0@lo:400:kworker.0 Request processed in 106us (5684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601468.370074:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1789601468.370129:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf7edfb80 x1876532880538624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601468.370144:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7edfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880538624:0@lo:400:kworker.0 00000100:00080000:2.0:1789601468.370180:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789601468.370185:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601468.370211:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7eddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880538496:0@lo:400:kworker.0 00000100:00100000:2.0:1789601468.370225:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880538368:0@lo:400:kworker.0 00010000:00010000:3.0:1789601468.428435:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601468.876195:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880539008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601468.876269:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601468.885677:0:10225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880539008 00000100:00100000:3.0:1789601468.885692:0:10225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880539008 00000100:00100000:3.0:1789601468.885812:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789601468.885824:0:10225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880539008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789601468.885892:0:10225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789601468.885975:0:10225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880539008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (9706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601468.885982:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789601468.886078:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880539008:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1789601469.003971:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789601469.452983:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601470.473177:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789601470.705094:0:11830:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 19:31:09 (1789601469) 00000100:00100000:3.0:1789601470.946357:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601470.946396:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601470.946417:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601470.946442:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858480128 00000100:00100000:3.0:1789601470.946451:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858480128 00000100:00100000:3.0:1789601470.946501:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 286 00000100:00100000:3.0:1789601470.946511:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2356:x1876532858480128:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601470.946578:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2356:x1876532858480128:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 69us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601470.946584:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 286 00000100:00100000:3.0:1789601470.946615:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858480384 00000100:00100000:3.0:1789601470.946620:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858480384 00000100:00100000:3.0:1789601470.946654:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858480256 00000100:00100000:3.0:1789601470.946657:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858480256 00000100:00100000:3.0:1789601470.946677:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 139 00000100:00100000:3.0:1789601470.946683:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858480384:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601470.952123:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 140 00000100:00100000:3.0:1789601470.952137:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2356:x1876532858480256:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601470.952295:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2356:x1876532858480256:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 162us (5875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601470.952303:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 140 00000100:00080000:3.0:1789601470.952451:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601470.952675:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858480384:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 5990us (6277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601470.952682:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 139 00000100:00100000:2.0:1789601471.433212:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880539136:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601471.433293:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601471.433456:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880539136 00000100:00100000:3.0:1789601471.433465:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880539136 00000100:00100000:3.0:1789601471.433527:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789601471.433537:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc7048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880539136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789601471.433573:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789601471.433620:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc7048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880539136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601471.433627:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789601471.433698:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789601471.433735:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edf8a0c700 x1876532880539136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601471.433753:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880539136:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789601471.497275:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601472.521791:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601472.872688:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601472.872890:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858480512 00000100:00100000:0.0:1789601472.872901:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858480512 00000100:00100000:0.0:1789601472.872976:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:0.0:1789601472.872989:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:10233:x1876532858480512:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601472.873009:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601472.873033:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac1a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061035 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601472.873095:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac1a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601472.873109:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac1a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601472.873144:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac1a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601472.873184:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789601472.873187:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789601472.873229:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac1a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601472.873252:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac1a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061035 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601472.873269:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac1a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061035 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601472.873278:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd0646e00) 00010000:00010000:0.0:1789601472.873280:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789601472.873284:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00925800, rc 0) 00000100:00100000:0.0:1789601472.873349:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:10233:x1876532858480512:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 365us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601472.873357:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00080000:2.0:1789601472.873635:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601472.878420:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601472.878593:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858480640 00000100:00100000:2.0:1789601472.878610:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858480640 00000100:00100000:2.0:1789601472.878694:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:2.0:1789601472.878708:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:10234:x1876532858480640:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601472.878735:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601472.878763:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac1b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506103c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.878882:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac1b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.878896:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac1b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.878926:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac1b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.878939:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac1be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.878944:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac1be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.878947:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac1be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879207:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c200/0xf3d6e402158ac1c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879213:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c200/0xf3d6e402158ac1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879218:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c200/0xf3d6e402158ac1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601472.879246:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789601472.879249:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789601472.879267:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c200/0xf3d6e402158ac1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879277:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac1b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879282:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac1b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879294:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac1b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879299:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c400 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601472.879302:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac1b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879308:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac1b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879319:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd0646e00) 00010000:00010000:2.0:1789601472.879322:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601472.879433:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac1b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879441:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac1b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879458:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac1be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879465:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac1be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879473:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac1be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879477:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8dc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601472.879480:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac1be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879492:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac1be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879498:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff91edd8a67b00) 00010000:00010000:2.0:1789601472.879499:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601472.879501:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac1be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879505:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac1be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879537:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac1b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506103c expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879551:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c200/0xf3d6e402158ac1c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506103c expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601472.879559:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91edd8a67e00) 00010000:00010000:2.0:1789601472.879561:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789601472.879563:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8c200, rc 0) 00000100:00100000:2.0:1789601472.879699:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:10234:x1876532858480640:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 992us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601472.879708:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:1.0:1789601472.891319:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601472.891448:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858480896 00000100:00100000:0.0:1789601472.891462:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858480896 00000100:00100000:0.0:1789601472.891540:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:0.0:1789601472.891553:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:10234:x1876532858480896:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601472.891581:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601472.891609:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac1cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061043 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.892198:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac1d3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.892217:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac1d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.892232:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac1d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.892252:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac1da lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.892259:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac1da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.892265:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac1da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.893222:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ac1e1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.893238:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ac1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.893249:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ac1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601472.893262:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789601472.899076:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac1d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.899101:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac1d3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.899112:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac1d3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.899119:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601472.899125:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac1d3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.899133:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac1d3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.899155:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91edd8a67e00) 00010000:00010000:1.0:1789601472.899159:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601472.899164:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac1d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.899188:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac1d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.899206:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac1da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.899210:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac1da lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.899214:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac1da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.899217:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601472.899219:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac1da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.899222:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac1da lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.899227:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91edd35e8500) 00010000:00010000:1.0:1789601472.899228:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601472.899230:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac1da lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.899233:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac1da lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.900043:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac1cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061043 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.900066:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ac1e1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061043 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601472.900083:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91edd35e8700) 00010000:00010000:1.0:1789601472.900086:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601472.900089:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88a00, rc 0) 00000100:00100000:1.0:1789601472.900348:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:10234:x1876532858480896:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 8795us (9039us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789601472.900359:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:3.0:1789601472.907806:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601472.908463:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858481024 00000100:00100000:0.0:1789601472.908479:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858481024 00000100:00100000:0.0:1789601472.908567:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:0.0:1789601472.908582:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:10234:x1876532858481024:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789601472.908765:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:10234:x1876532858481024:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 Request processed in 186us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601472.908774:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 35 00000040:00080000:0.0:1789601473.098354:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789601473.483999:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edefec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880539264:0@lo:400:kworker.0 00000100:00100000:0.0:1789601473.484119:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601473.486597:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880539264 00000100:00100000:1.0:1789601473.486619:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880539264 00000100:00100000:1.0:1789601473.486712:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789601473.486725:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3318:x1876532880539264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601473.486859:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0065c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3318:x1876532880539264:12345-0@lo:400:kworker.0 Request processed in 138us (2740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601473.486879:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789601473.492237:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edefec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880539648:0@lo:400:kworker.0 00000100:00100000:3.0:1789601473.492506:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601473.492625:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880539648 00000100:00100000:2.0:1789601473.492637:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880539648 00000100:00100000:2.0:1789601473.492734:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789601473.492748:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880539648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601473.492862:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00283800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880539648:12345-0@lo:400:kworker.0 Request processed in 117us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601473.492891:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1789601473.492987:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601473.493179:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edefec0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880539264:0@lo:400:kworker.0 00000100:00100000:0.0:1789601473.493190:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edefec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880539776:0@lo:400:kworker.0 00000100:00100000:0.0:1789601473.493228:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601473.494543:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edefec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880539392:0@lo:400:kworker.0 00000100:00100000:1.0:1789601473.494619:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601473.494670:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edefec1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880539904:0@lo:400:kworker.0 00000100:00100000:1.0:1789601473.494696:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601473.494721:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601473.494735:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edefec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880539520:0@lo:400:kworker.0 00000100:00100000:1.0:1789601473.494759:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601473.494804:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880539776 00000100:00100000:1.0:1789601473.494814:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880539776 00000100:00100000:1.0:1789601473.494983:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880539392 00000100:00100000:1.0:1789601473.494987:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880539392 00000100:00100000:1.0:1789601473.495017:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880539520 00000100:00100000:1.0:1789601473.495021:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880539520 00000100:00100000:1.0:1789601473.495042:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789601473.495050:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880539776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601473.495115:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880539776:12345-0@lo:400:kworker.0 Request processed in 65us (1887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601473.495123:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789601473.495144:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789601473.495151:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880539392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601473.495182:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880539392:12345-0@lo:400:kworker.0 Request processed in 31us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601473.495188:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789601473.495200:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789601473.495206:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880539520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601473.495232:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880539520:12345-0@lo:400:kworker.0 Request processed in 27us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601473.495238:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789601473.495287:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edefec1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880539776:0@lo:400:kworker.0 00000100:00080000:1.0:1789601473.495317:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601473.495522:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880539904 00000100:00100000:2.0:1789601473.495527:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880539904 00000100:00100000:2.0:1789601473.495562:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789601473.495570:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880539904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601473.495626:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880539904:12345-0@lo:400:kworker.0 Request processed in 57us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601473.495632:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1789601473.495962:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601473.495990:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edefec0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880539520:0@lo:400:kworker.0 00000100:00100000:1.0:1789601473.496003:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edefec0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880539392:0@lo:400:kworker.0 00000100:00100000:1.0:1789601473.496014:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edefec1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880539904:0@lo:400:kworker.0 00010000:00080000:3.0:1789601473.497771:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91edefec3100 x1876532880539648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789601489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601473.497792:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edefec3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880539648:0@lo:400:kworker.0 00010000:00010000:0.0:1789601473.549078:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601473.997945:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601473.997974:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880540032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601473.998083:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601473.998157:0:10225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880540032 00000100:00100000:1.0:1789601473.998168:0:10225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880540032 00000100:00100000:1.0:1789601473.998223:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789601473.998232:0:10225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880540032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601473.998276:0:10225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601473.998319:0:10225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880540032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601473.998326:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789601473.998375:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880540032:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789601474.572106:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601475.303730:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601475.303886:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858481152 00000100:00100000:2.0:1789601475.303900:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858481152 00000100:00100000:2.0:1789601475.303985:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:2.0:1789601475.303996:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:10277:x1876532858481152:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789601475.304022:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601475.304047:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158ac1ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506104a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304124:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac1f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304140:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac1f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304155:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac1f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304171:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac1fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304193:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac1fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304201:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac1fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304450:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac1f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304459:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac1f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304466:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac1f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304473:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601475.304478:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac1f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304486:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac1f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304627:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd0646e00) 00010000:00010000:2.0:1789601475.304631:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601475.304639:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac1f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304645:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac1f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304659:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac1fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304671:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac1fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304678:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac1fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304683:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601475.304686:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac1fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304692:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac1fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304700:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91edd8a67f00) 00010000:00010000:2.0:1789601475.304703:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601475.304706:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac1fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304712:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac1fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304832:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158ac1ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506104a expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304872:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd0646e00) 00010000:00010000:2.0:1789601475.304875:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601475.304879:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158ac1ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506104a expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.304890:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8d400, rc 0) 00000100:00100000:2.0:1789601475.304977:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:10277:x1876532858481152:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 981us (1259us total) trans 0 rc 301/301 00000100:00100000:2.0:1789601475.304985:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00080000:3.0:1789601475.305082:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601475.312344:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601475.312448:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858481408 00000100:00100000:2.0:1789601475.312462:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858481408 00000100:00100000:2.0:1789601475.312552:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:2.0:1789601475.312564:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:10277:x1876532858481408:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:2.0:1789601475.312655:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601475.312691:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac1a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061035 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.312715:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd0646e00) 00010000:00010000:2.0:1789601475.312731:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601475.313068:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac204 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.313085:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac204 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.313096:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac204 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.313110:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ac20b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.313117:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ac20b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.313124:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ac20b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601475.314165:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789601475.314185:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac204 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.314194:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac204 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.314201:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac204 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.314208:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8ce00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601475.314212:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac204 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.314219:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac204 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.314234:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8a67100) 00010000:00010000:2.0:1789601475.314237:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601475.314241:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac204 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.314248:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac204 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601475.314270:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000084ba6a45 reply state 00000000aed3d239 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ac20b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601475.314280:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789601475.314411:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+10:10277:x1876532858481408:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 1845us (2079us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789601475.314432:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 37 00010000:00010000:1.0:1789601475.317916:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ac20b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601475.317939:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ac20b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601475.317948:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ac20b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601475.317955:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601475.317962:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ac20b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601475.317971:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ac20b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601475.317992:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91edd8a67300) 00010000:00010000:1.0:1789601475.317995:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601475.318002:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ac20b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601475.318020:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ac20b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601475.479586:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601475.479745:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858481536 00000100:00100000:2.0:1789601475.479758:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858481536 00000100:00100000:2.0:1789601475.479874:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:2.0:1789601475.479888:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:10285:x1876532858481536:12345-192.168.201.30@tcp:101:lctl.0 00010000:00010000:2.0:1789601475.479921:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601475.479949:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061051 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.480030:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158ac219 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.480046:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158ac219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.480060:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158ac219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601475.480106:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789601475.480110:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789601475.480162:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158ac219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.480191:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061051 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.480211:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158ac219 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061051 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.480244:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8a67100) 00010000:00010000:2.0:1789601475.480248:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789601475.480252:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8d400, rc 0) 00000100:00100000:2.0:1789601475.480333:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+10:10285:x1876532858481536:12345-192.168.201.30@tcp:101:lctl.0 Request processed in 448us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601475.480341:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:0.0:1789601475.562177:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601475.562774:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858481664 00000100:00100000:2.0:1789601475.562792:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858481664 00000100:00100000:2.0:1789601475.562922:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:2.0:1789601475.562936:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+10:10291:x1876532858481664:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1789601475.562966:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601475.562997:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac220 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061058 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563121:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac227 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563152:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac227 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563167:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac227 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563185:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac22e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563193:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac22e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563211:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac22e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563335:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ac235 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563343:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ac235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563350:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ac235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601475.563382:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789601475.563386:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789601475.563435:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ac235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563450:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac227 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563456:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac227 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563463:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac227 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563469:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601475.563473:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac227 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563481:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac227 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563690:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8a67100) 00010000:00010000:2.0:1789601475.563694:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601475.563701:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac227 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563707:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac227 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563724:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac22e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563730:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac22e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563737:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac22e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563743:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601475.563746:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac22e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563752:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac22e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563760:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91edd8a67f00) 00010000:00010000:2.0:1789601475.563762:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601475.563765:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac22e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563770:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac22e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563830:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac220 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061058 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563961:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ac235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061058 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.563969:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:2.0:1789601475.563972:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789601475.563975:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8d600, rc 0) 00000100:00100000:2.0:1789601475.564065:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+11:10291:x1876532858481664:12345-192.168.201.30@tcp:101:bash.0 Request processed in 1131us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601475.564074:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:3.0:1789601475.573394:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601475.573568:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858481920 00000100:00100000:2.0:1789601475.573581:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858481920 00000100:00100000:2.0:1789601475.573666:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:2.0:1789601475.573679:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+11:10291:x1876532858481920:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1789601475.573710:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601475.573739:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac23c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506105f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.573933:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac243 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.573951:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac243 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.573964:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac243 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.573997:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac24a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.574016:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac24a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.574023:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac24a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789601475.574757:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789601475.575001:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac251 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.575015:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.575025:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.575060:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac243 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.575069:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac243 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.575077:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac243 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.575083:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c400 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601475.575088:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac243 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.575107:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac243 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.575121:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:2.0:1789601475.575124:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601475.575130:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac243 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.575137:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac243 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601475.575154:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b6ac6c9 reply state 000000001207b691 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac24a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601475.575164:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789601475.575202:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac23c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506105f expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.575219:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac251 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506105f expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.575227:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67d00) 00010000:00010000:2.0:1789601475.575229:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601475.575232:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8d200, rc 0) 00000100:00100000:2.0:1789601475.575333:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:10291:x1876532858481920:12345-192.168.201.30@tcp:101:bash.0 Request processed in 1656us (1953us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789601475.575343:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 40 00010000:00010000:2.0:1789601475.577492:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac24a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.577531:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac24a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.577539:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac24a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.577546:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8dc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601475.577551:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac24a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.577561:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac24a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.577580:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91edd8a67900) 00010000:00010000:2.0:1789601475.577584:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601475.577590:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac24a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.577597:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac24a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601475.578781:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601475.578942:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858482048 00000100:00100000:2.0:1789601475.578956:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858482048 00000100:00100000:2.0:1789601475.579019:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:2.0:1789601475.579030:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2355:x1876532858482048:12345-192.168.201.30@tcp:8:bash.0 00010000:00080000:2.0:1789601475.579072:0:11670:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp t0 exp 0000000000000000 cur 345 last 0 00000020:00000080:2.0:1789601475.579120:0:11670:0:(genops.c:1384:class_connect()) connect: client 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6, cookie 0xf3d6e402158ac25f 00002000:00100000:2.0:1789601475.579149:0:11670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6/ffff91edefeed800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789601475.579202:0:11670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789601475.579496:0:11670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789601475.579537:0:11670:0:(import.c:65:import_set_state_nolock()) ffff91edefeed000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789601475.580801:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2355:x1876532858482048:12345-192.168.201.30@tcp:8:bash.0 Request processed in 1760us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601475.580816:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00010000:00010000:2.0:1789601475.593275:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601475.594960:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601475.595076:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858482176 00000100:00100000:2.0:1789601475.595090:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858482176 00000100:00100000:2.0:1789601475.595178:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:2.0:1789601475.595190:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00280380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:0:x1876532858482176:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1789601475.595216:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601475.595246:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027e4a5f2/0xf3d6e402158ac266 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061066 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789601475.595282:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789601475.595307:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1789601475.595312:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601475.595323:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027e4a5f2/0xf3d6e402158ac266 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061066 expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.595350:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027e4a5f2/0xf3d6e402158ac266 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061066 expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.595365:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8ce00, rc 0) 00000100:00100000:2.0:1789601475.595445:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00280380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:0:x1876532858482176:12345-192.168.201.30@tcp:101:bash.0 Request processed in 257us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601475.595470:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00080000:3.0:1789601475.595590:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601475.599310:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601475.602058:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858482304 00000100:00100000:0.0:1789601475.602082:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858482304 00000100:00100000:0.0:1789601475.602442:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:0.0:1789601475.602457:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:10291:x1876532858482304:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1789601475.602483:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601475.602510:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ac26d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506106d expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601475.602580:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027e4a5f2/0xf3d6e402158ac266 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061066 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601475.602591:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601475.602596:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601475.602603:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ac26d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506106d expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601475.602660:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000027e4a5f2/0xf3d6e402158ac266 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061066 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601475.602677:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000027e4a5f2/0xf3d6e402158ac266 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061066 expref: 8 pid: 6676 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601475.602694:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1876532880540160:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789601475.602831:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601475.608649:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601475.608897:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1876532880540160:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789601475.608943:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ac26d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506106d expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601475.608971:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00925400, rc 0) 00000100:00100000:0.0:1789601475.609047:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00283100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:10291:x1876532858482304:12345-192.168.201.30@tcp:101:bash.0 Request processed in 6594us (9752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601475.609058:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:3.0:1789601475.609178:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858482432 00000100:00100000:3.0:1789601475.609188:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858482432 00010000:00010000:3.0:1789601475.609231:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027e4a5f2/0xf3d6e402158ac266 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061066 expref: 8 pid: 6676 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601475.609267:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:3.0:1789601475.609276:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2356:x1876532858482432:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601475.609293:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601475.609323:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027e4a5f2/0xf3d6e402158ac266 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061066 expref: 8 pid: 6676 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601475.609338:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027e4a5f2/0xf3d6e402158ac266 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061066 expref: 8 pid: 6676 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601475.609370:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027e4a5f2/0xf3d6e402158ac266 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061066 expref: 8 pid: 6676 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601475.609388:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601475.609399:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601475.609409:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ac26d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506106d expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601475.609422:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ac26d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506106d expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601475.609466:0:8437:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ac26d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506106d expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601475.609483:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00281f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8437:1876532880540288:192.168.201.30@tcp:105: 00000100:00100000:3.0:1789601475.609553:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede9e69480 going to sleep for 11 seconds 00000100:00100000:2.0:1789601475.621959:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00281f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8437:1876532880540288:192.168.201.30@tcp:105: 00010000:00010000:2.0:1789601475.621995:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601475.622074:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2356:x1876532858482432:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 12798us (13439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601475.622090:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:1.0:1789601475.635706:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601475.635879:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858482688 00000100:00100000:2.0:1789601475.635895:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858482688 00000100:00100000:2.0:1789601475.635974:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:2.0:1789601475.635987:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:10291:x1876532858482688:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:2.0:1789601475.636517:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:10291:x1876532858482688:12345-192.168.201.30@tcp:35:bash.0 Request processed in 527us (821us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789601475.636527:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:1.0:1789601475.781327:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601475.781468:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858482944 00000100:00100000:3.0:1789601475.781481:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858482944 00000100:00100000:3.0:1789601475.781581:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:3.0:1789601475.781593:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:10301:x1876532858482944:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601475.781637:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601475.781667:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac274 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061074 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601475.781822:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789601475.782044:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac274 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061074 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601475.782063:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8a67100) 00010000:00010000:3.0:1789601475.782066:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601475.782072:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac274 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061074 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601475.782103:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc600, rc 0) 00000100:00100000:3.0:1789601475.782191:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+15:10301:x1876532858482944:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 600us (878us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1789601475.782199:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:3.0:1789601475.792002:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601475.792238:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858483200 00000100:00100000:2.0:1789601475.792252:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858483200 00000100:00100000:2.0:1789601475.792337:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1789601475.792350:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+15:10301:x1876532858483200:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789601475.792693:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+16:10301:x1876532858483200:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 345us (720us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789601475.792701:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1789601475.895528:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601475.895660:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858483328 00000100:00100000:2.0:1789601475.895671:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858483328 00000100:00100000:2.0:1789601475.895741:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:2.0:1789601475.895752:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+16:10307:x1876532858483328:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789601475.895794:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601475.895817:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac282 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506107b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.895945:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac289 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.895960:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.895972:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601475.896004:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789601475.896008:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789601475.896028:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.896052:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac282 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506107b expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.896071:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac289 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506107b expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.896078:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:2.0:1789601475.896081:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789601475.896085:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8de00, rc 0) 00000100:00100000:2.0:1789601475.896145:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+17:10307:x1876532858483328:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 395us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601475.896152:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:3.0:1789601475.904675:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601475.904770:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858483584 00000100:00100000:2.0:1789601475.904781:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858483584 00000100:00100000:2.0:1789601475.904876:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:2.0:1789601475.904888:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+17:10307:x1876532858483584:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789601475.904911:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601475.904944:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac290 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061082 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.905055:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac297 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.905069:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.905080:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601475.905091:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789601475.905217:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac290 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061082 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.905235:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac297 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061082 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.905244:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67d00) 00010000:00010000:2.0:1789601475.905247:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601475.905251:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8c600, rc 0) 00000100:00100000:2.0:1789601475.905306:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00282680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:10307:x1876532858483584:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 421us (641us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789601475.905331:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:3.0:1789601475.909981:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601475.910174:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858483840 00000100:00100000:2.0:1789601475.910187:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858483840 00000100:00100000:2.0:1789601475.910239:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:2.0:1789601475.910252:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:10307:x1876532858483840:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789601475.910277:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601475.910299:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac2a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061089 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.910404:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac2ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.910420:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac2ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.910431:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac2ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601475.910444:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789601475.910564:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac2a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061089 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.910584:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac2ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061089 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.910592:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67d00) 00010000:00010000:2.0:1789601475.910596:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789601475.910626:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8d000, rc 0) 00000100:00100000:2.0:1789601475.910706:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:10307:x1876532858483840:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 458us (737us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789601475.910714:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:3.0:1789601475.911461:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601475.912307:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858483968 00000100:00100000:1.0:1789601475.912317:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858483968 00000100:00100000:1.0:1789601475.912376:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:1.0:1789601475.912385:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00281c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:2358:x1876532858483968:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601475.912398:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601475.912419:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac297 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061082 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601475.912436:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67d00) 00010000:00010000:1.0:1789601475.912440:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601475.912481:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00281c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:2358:x1876532858483968:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 98us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601475.912488:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:3.0:1789601475.922523:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601475.922628:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858484096 00000100:00100000:2.0:1789601475.922638:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858484096 00000100:00100000:2.0:1789601475.922704:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:2.0:1789601475.922716:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2356:x1876532858484096:12345-192.168.201.30@tcp:1:lfs.0 00010000:00010000:2.0:1789601475.922767:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fb9b826/0xf3d6e402158ac2ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.922788:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ac26d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506106d expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.922798:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601475.922802:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789601475.922806:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fb9b826/0xf3d6e402158ac2ba lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.922885:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ac26d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506106d expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601475.922900:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ac26d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506106d expref: 7 pid: 6677 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601475.922925:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc7048e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1876532880540416:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789601475.923027:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8968f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601475.931161:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601475.932116:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858484224 00000100:00100000:0.0:1789601475.932131:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858484224 00002000:00100000:0.0:1789601475.932210:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff91ee00282300 x1876532858484224/t0(0) o4->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:71/0 lens 504/0 e 0 to 0 dl 1789601486 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789601475.932223:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91ee00282300 with x1876532858484224 ext(0->12) 00010000:00010000:0.0:1789601475.932233:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ac26d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506106d expref: 8 pid: 6677 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601475.932255:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ac26d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506106d expref: 8 pid: 6677 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789601475.932264:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91ee00282300 00000100:00100000:0.0:1789601475.932296:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:0.0:1789601475.932306:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2357:x1876532858484224:12345-192.168.201.30@tcp:4:lfs.0 00000100:00100000:2.0:1789601475.933271:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc7048e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1876532880540416:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789601475.933300:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003fb9b826/0xf3d6e402158ac2ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1789601476.004209:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 00000100:00100000:3.0:1789601476.060487:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601476.060708:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601476.060742:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858484352 00000100:00100000:3.0:1789601476.060753:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858484352 00000100:00100000:3.0:1789601476.060807:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 288 00000100:00100000:3.0:1789601476.060817:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2357:x1876532858484352:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601476.060910:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0067c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2357:x1876532858484352:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 95us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601476.060918:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 288 00000100:00100000:3.0:1789601476.060955:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858484480 00000100:00100000:3.0:1789601476.060959:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858484480 00000100:00100000:3.0:1789601476.060995:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 144 00000100:00100000:3.0:1789601476.061002:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85db4f7d-704a-4080-a137-b2930e072a8c+5:2357:x1876532858484480:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601476.061031:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85db4f7d-704a-4080-a137-b2930e072a8c+5:2357:x1876532858484480:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 30us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601476.061052:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 144 00000100:00080000:3.0:1789601476.061608:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601476.084548:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:2357:x1876532858484224:12345-192.168.201.30@tcp:4:lfs.0 Request processed in 152232us (153387us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789601476.084570:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00002000:00100000:2.0:1789601476.084584:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff91ee00282300 x1876532858484224/t4294967299(0) o4->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:71/0 lens 504/448 e 0 to 0 dl 1789601486 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789601476.084594:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91ee00282300 with x1876532858484224 ext(0->12) 00010000:00010000:2.0:1789601476.084616:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ac26d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506106d expref: 9 pid: 6677 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.084635:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ac26d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506106d expref: 9 pid: 6677 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789601476.084644:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91ee00282300 00000001:00080000:2.0:1789601476.084683:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1789601476.091514:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601476.091609:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858484608 00000100:00100000:1.0:1789601476.091619:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858484608 00010000:00010000:1.0:1789601476.091656:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ac26d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506106d expref: 7 pid: 6677 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601476.091742:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:1.0:1789601476.091760:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00280a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2356:x1876532858484608:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601476.091787:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789601476.091806:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789601476.091809:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789601476 00002000:00010000:1.0:1789601476.091812:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789601477 00002000:00010000:1.0:1789601476.091814:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789601476 00002000:00010000:1.0:1789601476.091816:0:5823:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1789601476.091822:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ac26d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506106d expref: 7 pid: 6677 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.091858:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ac26d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506106d expref: 7 pid: 6677 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.091887:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ac26d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506106d expref: 7 pid: 6677 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.091904:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1789601476.091909:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601476.091915:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003fb9b826/0xf3d6e402158ac2ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.091926:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fb9b826/0xf3d6e402158ac2ba lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.091951:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601476.091997:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00280a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858484608:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 247us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601476.092004:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 36 00010000:00010000:3.0:1789601476.092059:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003fb9b826/0xf3d6e402158ac2ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601476.092068:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fb9b826/0xf3d6e402158ac2ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601476.092091:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fb9b826/0xf3d6e402158ac2ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601476.092107:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fb9b826/0xf3d6e402158ac2ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601476.092116:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fb9b826/0xf3d6e402158ac2ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601476.092123:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c400 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601476.092128:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fb9b826/0xf3d6e402158ac2ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601476.092137:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fb9b826/0xf3d6e402158ac2ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601476.092150:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fb9b826/0xf3d6e402158ac2ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601476.092165:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fb9b826/0xf3d6e402158ac2ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601476.092208:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2356:x1876532858484096:12345-192.168.201.30@tcp:1:lfs.0 Request processed in 169496us (169696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601476.092216:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:3.0:1789601476.120159:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601476.124363:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858484864 00000100:00100000:0.0:1789601476.124381:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858484864 00000100:00100000:0.0:1789601476.124471:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:0.0:1789601476.124484:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:10307:x1876532858484864:12345-192.168.201.30@tcp:35:lfs.0 00000004:00010000:0.0:1789601476.124554:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac2ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061089 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789601476.125623:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1789601476.125687:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1789601476.128343:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1789601476.128430:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.128455:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac251 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506105f expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.128465:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2c1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.128507:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac251 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506105f expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.128526:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac251 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506105f expref: 24 pid: 5838 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601476.128542:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1876532880540544:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789601476.128654:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc51500c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601476.138111:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1876532880540544:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601476.138146:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601476.140496:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601476.140737:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858484992 00000100:00100000:1.0:1789601476.140749:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858484992 00010000:00010000:1.0:1789601476.140791:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac251 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506105f expref: 25 pid: 5838 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601476.140871:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:1.0:1789601476.140898:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00283b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+25:2356:x1876532858484992:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601476.140914:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601476.140922:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac251 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506105f expref: 25 pid: 5838 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.140936:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac251 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506105f expref: 25 pid: 5838 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.140957:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac251 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506105f expref: 25 pid: 5838 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.140975:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67d00) 00010000:00010000:1.0:1789601476.140980:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.140990:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.140998:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2c1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.141021:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601476.141074:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00283b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+24:2356:x1876532858484992:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 180us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601476.141081:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 37 00010000:00010000:3.0:1789601476.143009:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601476.143028:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601476.143172:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1789601476.143467:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1789601476.143612:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00281f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1876532880540672:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789601476.143695:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601476.143739:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8968f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601476.144016:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880540672 00000100:00100000:1.0:1789601476.144025:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880540672 00000100:00100000:1.0:1789601476.144082:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789601476.144091:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1876532880540672:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789601476.144188:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1876532880540672:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 98us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601476.144195:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789601476.144216:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601476.144893:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00281f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1876532880540672:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789601476.149314:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1789601476.149515:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1876532880540800:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789601476.149588:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601476.149636:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc46689c0 going to sleep for 11 seconds 00000001:00080000:2.0:1789601476.150148:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000001:00080000:2.0:1789601476.150160:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967316 is committed 00000100:00100000:1.0:1789601476.150850:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880540800 00000100:00100000:1.0:1789601476.150862:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880540800 00000100:00100000:1.0:1789601476.150917:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789601476.150927:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1876532880540800:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789601476.151245:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1876532880540800:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 319us (1656us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789601476.151253:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789601476.151813:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002eaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1876532880540800:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789601476.151919:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1789601476.151963:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601476.151975:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2c1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601476.151982:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601476.151989:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601476.151993:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601476.152000:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2c1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601476.152016:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67d00) 00010000:00010000:3.0:1789601476.152019:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789601476.152025:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2c1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601476.152031:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2c1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789601476.152611:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789601476.152826:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789601476.153871:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 346192032981ns, next at 347192025347ns, rc = 0 00000001:00080000:3.0:1789601476.153890:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1789601476.153954:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67d00) 00010000:00010000:3.0:1789601476.153959:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789601476.153983:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac2ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061089 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601476.154563:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:10307:x1876532858484864:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 29855us (34185us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1789601476.154576:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000020:00080000:3.0:1789601476.154583:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789601476.161453:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601476.161653:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858485120 00000100:00100000:2.0:1789601476.161663:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858485120 00000100:00100000:2.0:1789601476.162057:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:2.0:1789601476.162069:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:10307:x1876532858485120:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789601476.162102:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601476.162126:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac2c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061090 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.162294:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac2c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061090 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.162310:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac2c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061090 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.162331:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:1.0:1789601476.162334:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789601476.162338:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8cc00, rc 0) 00000100:00100000:1.0:1789601476.162401:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:10307:x1876532858485120:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 335us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601476.162412:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:0.0:1789601476.169351:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601476.169430:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858485376 00000100:00100000:3.0:1789601476.169440:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858485376 00000100:00100000:3.0:1789601476.169550:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:3.0:1789601476.169561:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91eddcdad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:10307:x1876532858485376:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1789601476.169825:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91eddcdad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:10307:x1876532858485376:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 265us (482us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1789601476.169833:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:2.0:1789601476.329017:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601476.329122:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858485632 00000100:00100000:3.0:1789601476.329133:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858485632 00000100:00100000:3.0:1789601476.329198:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:3.0:1789601476.329208:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc7048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:10317:x1876532858485632:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601476.329231:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601476.329253:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac2cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061097 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601476.329361:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789601476.329503:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac2cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061097 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601476.329547:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8a67100) 00010000:00010000:3.0:1789601476.329550:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601476.329556:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac2cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061097 expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601476.329573:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadca00, rc 0) 00000100:00100000:3.0:1789601476.329654:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc7048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:10317:x1876532858485632:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 446us (647us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1789601476.329661:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:0.0:1789601476.335131:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601476.335223:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858485760 00000100:00100000:1.0:1789601476.335235:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858485760 00000100:00100000:1.0:1789601476.335297:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:1.0:1789601476.335317:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:10317:x1876532858485760:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:1.0:1789601476.335418:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac2dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335435:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac2dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335446:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac2dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335463:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac2e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335470:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335476:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335761:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335771:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335778:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789601476.335824:0:8248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335872:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac2dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335890:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac2dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335896:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac2dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335902:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601476.335907:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac2dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335915:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac2dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335927:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:1.0:1789601476.335930:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601476.335935:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac2dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335940:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac2dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335954:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335960:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac2e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335966:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335971:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601476.335978:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335984:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac2e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.335991:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91edd35e8a00) 00010000:00010000:1.0:1789601476.335993:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601476.335996:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac2e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.336001:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac2e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.336013:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.336019:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.336025:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.336029:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601476.336033:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.336038:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.336045:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:1.0:1789601476.336047:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601476.336054:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.336060:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac2eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601476.336146:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:10317:x1876532858485760:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 830us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601476.336154:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:1.0:1789601476.345902:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601476.346421:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858486016 00000100:00100000:3.0:1789601476.346433:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858486016 00000100:00100000:3.0:1789601476.346497:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:3.0:1789601476.346507:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:10317:x1876532858486016:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1789601476.347355:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+23:10317:x1876532858486016:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 845us (1459us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789601476.347363:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:3.0:1789601476.466186:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601476.466315:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858486272 00000100:00100000:2.0:1789601476.466327:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858486272 00000100:00100000:2.0:1789601476.466393:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:2.0:1789601476.466405:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+23:10320:x1876532858486272:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789601476.466437:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601476.466459:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac2f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506109e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.466542:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac2f9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.466557:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac2f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.466568:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac2f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.466585:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac300 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.466623:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.466630:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.466949:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac307 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.466968:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.466975:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac307 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601476.466986:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789601476.467078:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac2f9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.467085:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac2f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.467092:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac2f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.467098:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8da00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601476.467102:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac2f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.467109:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac2f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.467121:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:2.0:1789601476.467124:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601476.467129:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac2f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.467135:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac2f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.467149:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.467161:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac300 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.467166:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.467172:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601476.467175:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.467182:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac300 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.467189:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91edd8a67900) 00010000:00010000:2.0:1789601476.467192:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601476.467195:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac300 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.467200:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac300 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.467247:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac2f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506109e expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.467260:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac307 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506109e expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.467267:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:2.0:1789601476.467270:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601476.467278:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8c000, rc 0) 00000100:00100000:2.0:1789601476.467351:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+25:10320:x1876532858486272:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 947us (1172us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789601476.467359:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:0.0:1789601476.473576:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601476.473748:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858486400 00000100:00100000:1.0:1789601476.473761:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858486400 00000100:00100000:1.0:1789601476.473824:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:1.0:1789601476.473861:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+25:10320:x1876532858486400:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:1.0:1789601476.473940:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac315 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.473958:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.473972:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.473999:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.474006:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac315 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.474013:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac315 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.474036:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601476.474040:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac315 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.474049:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac315 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.474064:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:1.0:1789601476.474066:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789601476.474071:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac315 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601476.474077:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ac315 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601476.474156:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+25:10320:x1876532858486400:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 323us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601476.474164:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:1.0:1789601476.487050:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601476.487274:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858486656 00000100:00100000:0.0:1789601476.487311:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858486656 00000100:00100000:0.0:1789601476.487368:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1789601476.487379:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+25:10320:x1876532858486656:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1789601476.488089:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+26:10320:x1876532858486656:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 709us (1045us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789601476.488099:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1789601476.554429:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601476.554458:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880540928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601476.554550:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601476.554975:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880540928 00000100:00100000:1.0:1789601476.554985:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880540928 00000100:00100000:1.0:1789601476.555053:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789601476.555065:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1876532880540928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601476.555091:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1789601476.555153:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1876532880540928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601476.555159:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789601476.555986:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880540928:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789601476.620189:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601476.882681:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601476.882946:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858486912 00000100:00100000:2.0:1789601476.882957:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858486912 00000100:00100000:2.0:1789601476.883023:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:2.0:1789601476.883035:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+26:10351:x1876532858486912:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:2.0:1789601476.883058:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601476.883081:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac31c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50610a5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.883192:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac323 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.883207:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.883220:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601476.883231:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789601476.883400:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac31c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610a5 expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.883422:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac323 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610a5 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.883432:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:2.0:1789601476.883442:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601476.883446:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8d000, rc 0) 00000100:00100000:2.0:1789601476.884252:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+28:10351:x1876532858486912:12345-192.168.201.30@tcp:101:cat.0 Request processed in 1215us (1576us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789601476.884261:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:1.0:1789601476.891041:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601476.891232:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858487168 00000100:00100000:3.0:1789601476.891243:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858487168 00000100:00100000:3.0:1789601476.891300:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:3.0:1789601476.891311:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+28:10351:x1876532858487168:12345-192.168.201.30@tcp:35:cat.0 00000100:00100000:3.0:1789601476.891914:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+29:10351:x1876532858487168:12345-192.168.201.30@tcp:35:cat.0 Request processed in 602us (879us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789601476.891936:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:1.0:1789601476.896153:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601476.896338:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858487296 00000100:00100000:2.0:1789601476.896349:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858487296 00000100:00100000:2.0:1789601476.896417:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:2.0:1789601476.896428:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede51e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+29:2359:x1876532858487296:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601476.896444:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601476.896471:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac323 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610a5 expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601476.896491:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:2.0:1789601476.896496:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601476.897091:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede51e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+28:2359:x1876532858487296:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 662us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601476.897101:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:3.0:1789601477.021245:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601477.021461:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858487552 00000100:00100000:1.0:1789601477.021472:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858487552 00000100:00100000:1.0:1789601477.021554:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:1.0:1789601477.021565:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+28:10357:x1876532858487552:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1789601477.021616:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601477.021620:0:8248:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789601477.021651:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac289 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506107b expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.021691:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:1.0:1789601477.021696:0:8248:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789601477.021724:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac331 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50610ac expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.021829:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac338 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.021901:0:8248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac307 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506109e expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.021910:0:8248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac338 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.021944:0:8248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac307 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506109e expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.021958:0:8248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac307 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506109e expref: 28 pid: 5837 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601477.021989:0:8248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880541056:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789601477.022299:0:8248:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc51500c0 going to sleep for 11 seconds 00000100:00080000:3.0:1789601477.022610:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601477.030544:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601477.030572:0:8248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880541056:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789601477.030611:0:8248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac338 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601477.030687:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858487680 00000100:00100000:2.0:1789601477.030697:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858487680 00010000:00010000:2.0:1789601477.030746:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac307 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506109e expref: 29 pid: 5837 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601477.030794:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:2.0:1789601477.030804:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+29:2357:x1876532858487680:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601477.030820:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601477.030827:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac307 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506109e expref: 29 pid: 5837 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.030890:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac307 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506109e expref: 29 pid: 5837 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.030912:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac307 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506109e expref: 29 pid: 5837 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.030929:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:2.0:1789601477.030934:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac338 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.030943:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac338 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.030951:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac338 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.030981:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601477.031035:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+28:2357:x1876532858487680:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 232us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601477.031043:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00010000:00010000:1.0:1789601477.031196:0:8248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac338 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.031204:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac338 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601477.031225:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789601477.031400:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac331 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610ac expref: 29 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.031417:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac338 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610ac expref: 28 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.031423:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:1.0:1789601477.031426:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789601477.031428:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b89000, rc 0) 00000100:00100000:1.0:1789601477.031452:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+28:10357:x1876532858487552:12345-192.168.201.30@tcp:101:dd.0 Request processed in 9891us (10218us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789601477.031459:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:0.0:1789601477.039666:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601477.039770:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858487936 00000100:00100000:3.0:1789601477.039783:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858487936 00000100:00100000:3.0:1789601477.039882:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:3.0:1789601477.039892:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+28:10357:x1876532858487936:12345-192.168.201.30@tcp:36:dd.0 00010000:00010000:3.0:1789601477.040314:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac346 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.040332:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.040344:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601477.040393:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1789601477.040427:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086cffc46 reply state 0000000098228d6f transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601477.040436:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789601477.040596:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+31:10357:x1876532858487936:12345-192.168.201.30@tcp:36:dd.0 Request processed in 704us (940us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1789601477.040603:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00000020:00080000:3.0:1789601477.040608:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789601477.053309:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.053330:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac346 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.053365:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac346 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.053373:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadca00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601477.053379:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac346 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.053389:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac346 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.053407:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:1.0:1789601477.053411:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601477.053415:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac346 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.053423:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac346 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601477.497350:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601477.497628:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858488064 00000100:00100000:2.0:1789601477.497639:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858488064 00000100:00100000:2.0:1789601477.497717:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:2.0:1789601477.497727:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+30:10371:x1876532858488064:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:2.0:1789601477.497753:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601477.497775:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac34d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50610b3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.497912:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac354 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.497928:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac354 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.497940:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac354 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.497956:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac35b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.497962:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac35b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.497969:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac35b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.498204:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac362 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.498216:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac338 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610ac expref: 31 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.498225:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac362 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.498256:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac338 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610ac expref: 31 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.498279:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac338 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610ac expref: 31 pid: 8248 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601477.498292:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc704b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1876532880541184:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789601477.498390:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede9e69840 going to sleep for 11 seconds 00000100:00100000:3.0:1789601477.516182:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601477.516221:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc704b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1876532880541184:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789601477.516248:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac362 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601477.516328:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858488320 00000100:00100000:0.0:1789601477.516336:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858488320 00000100:00100000:0.0:1789601477.516383:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:0.0:1789601477.516390:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+32:5596:x1876532858488320:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789601477.516820:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+33:5596:x1876532858488320:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 427us (648us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1789601477.516829:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:0.0:1789601477.520029:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601477.520140:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858488448 00000100:00100000:1.0:1789601477.520150:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858488448 00010000:00010000:1.0:1789601477.520192:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac338 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610ac expref: 33 pid: 8248 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601477.520237:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:1.0:1789601477.520247:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+33:2356:x1876532858488448:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601477.520262:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601477.520270:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac338 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610ac expref: 33 pid: 8248 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.520305:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac338 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610ac expref: 33 pid: 8248 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.520328:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac338 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610ac expref: 33 pid: 8248 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.520348:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:1.0:1789601477.520353:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac362 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.520362:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.520370:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac362 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601477.520408:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601477.520466:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+32:2356:x1876532858488448:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 220us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601477.520474:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00010000:00010000:3.0:1789601477.520538:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.520547:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601477.520607:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789601477.520612:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789601477.520670:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.520685:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.520706:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac354 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.520715:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac354 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.520722:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac354 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.520729:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601477.520735:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac354 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.520742:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac354 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.520752:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:3.0:1789601477.520754:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601477.520758:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac354 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.520763:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac354 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.520785:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac35b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.520791:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac35b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.520797:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac35b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.520802:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8da00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601477.520804:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac35b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.520810:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac35b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.520817:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91edd8a67900) 00010000:00010000:3.0:1789601477.520820:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601477.520823:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac35b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.520828:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac35b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.520929:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac34d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610b3 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.520946:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac362 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610b3 expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601477.520965:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:3.0:1789601477.520967:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601477.520970:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8d200, rc 0) 00000100:00100000:3.0:1789601477.520999:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+31:10371:x1876532858488064:12345-192.168.201.30@tcp:101:stat.0 Request processed in 23273us (23662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601477.521006:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00010000:00010000:2.0:1789601477.641175:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601477.660502:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601477.660633:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858488704 00000100:00100000:2.0:1789601477.660644:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858488704 00000100:00100000:2.0:1789601477.660709:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:2.0:1789601477.660719:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+31:10376:x1876532858488704:12345-192.168.201.30@tcp:36:truncate.0 00010000:00010000:2.0:1789601477.660783:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601477.660811:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac362 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610b3 expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.660832:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:2.0:1789601477.661010:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601477.661230:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac369 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.661245:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.661429:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789601477.661496:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1789601477.661522:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018756e05 reply state 000000002c4a5219 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601477.661531:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789601477.661657:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+33:10376:x1876532858488704:12345-192.168.201.30@tcp:36:truncate.0 Request processed in 938us (1164us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789601477.661665:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00000020:00080000:2.0:1789601477.661670:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789601477.667083:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.667106:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac369 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.667115:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac369 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.667123:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8dc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601477.667128:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac369 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.667136:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac369 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.667153:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:2.0:1789601477.667156:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601477.667161:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac369 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601477.667167:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac369 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601477.876965:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601477.879647:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858488832 00000100:00100000:0.0:1789601477.879665:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858488832 00000100:00100000:0.0:1789601477.879772:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:0.0:1789601477.879783:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+32:10391:x1876532858488832:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:0.0:1789601477.879809:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601477.879832:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ac370 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50610ba expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.879964:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158ac377 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.879978:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158ac377 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.879990:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158ac377 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880005:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac37e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880011:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac37e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880018:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac37e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880261:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac385 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880276:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880284:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601477.880328:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789601477.880333:0:8248:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789601477.880354:0:8248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880366:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880374:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158ac377 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880381:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158ac377 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880388:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158ac377 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880394:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601477.880399:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158ac377 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880406:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158ac377 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880419:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:0.0:1789601477.880422:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601477.880427:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158ac377 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880432:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158ac377 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880455:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac37e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880461:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac37e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880467:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac37e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880472:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601477.880475:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac37e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880481:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac37e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880488:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91edd0646300) 00010000:00010000:0.0:1789601477.880490:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601477.880493:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac37e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880499:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac37e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880533:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ac370 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610ba expref: 34 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880545:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610ba expref: 33 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601477.880564:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:0.0:1789601477.880577:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789601477.880580:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00925e00, rc 0) 00000100:00100000:0.0:1789601477.880645:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+33:10391:x1876532858488832:12345-192.168.201.30@tcp:101:stat.0 Request processed in 863us (3690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601477.880652:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:0.0:1789601478.042825:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601478.044443:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858489088 00000100:00100000:3.0:1789601478.044458:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858489088 00000100:00100000:3.0:1789601478.044534:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:3.0:1789601478.044546:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+33:10401:x1876532858489088:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601478.044578:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601478.044602:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac38c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50610c1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601478.044706:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789601478.044831:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac38c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610c1 expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.044949:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8a67100) 00010000:00010000:3.0:1789601478.044953:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601478.044959:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac38c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610c1 expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.044974:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc600, rc 0) 00000100:00100000:3.0:1789601478.045107:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+34:10401:x1876532858489088:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 564us (2295us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1789601478.045133:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:1.0:1789601478.054419:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601478.054529:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858489344 00000100:00100000:3.0:1789601478.054540:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858489344 00000100:00100000:3.0:1789601478.054656:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:3.0:1789601478.054670:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+34:10401:x1876532858489344:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1789601478.054996:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+35:10401:x1876532858489344:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 329us (753us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1789601478.055005:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:1.0:1789601478.201281:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601478.201401:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858489600 00000100:00100000:0.0:1789601478.201412:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858489600 00000100:00100000:0.0:1789601478.201479:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:0.0:1789601478.201497:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+35:10407:x1876532858489600:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1789601478.201522:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601478.201545:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ac39a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50610c8 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.201657:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac3a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.201673:0:8248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac385 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610ba expref: 36 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.201691:0:8248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac3a1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.201728:0:8248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610ba expref: 36 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.201754:0:8248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac385 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610ba expref: 36 pid: 8248 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601478.201768:0:8248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880541312:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789601478.201887:0:8248:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc702f300 going to sleep for 11 seconds 00000100:00100000:1.0:1789601478.205038:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601478.205256:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858489728 00000100:00100000:0.0:1789601478.205269:0:8248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880541312:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789601478.205299:0:8248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac3a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601478.205422:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858489728 00010000:00010000:2.0:1789601478.205461:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac385 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610ba expref: 37 pid: 8248 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601478.205512:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:2.0:1789601478.205523:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+37:2357:x1876532858489728:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601478.205538:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601478.205545:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac385 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610ba expref: 37 pid: 8248 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.205569:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610ba expref: 37 pid: 8248 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.205763:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac385 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610ba expref: 37 pid: 8248 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.205784:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:2.0:1789601478.205789:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac3a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.205799:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac3a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.205808:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac3a1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.205879:0:8248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac3a1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.205888:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac3a1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.205907:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:0.0:1789601478.205908:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789601478.206133:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ac39a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610c8 expref: 38 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.206148:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac3a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610c8 expref: 37 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.206157:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00000100:00100000:2.0:1789601478.206161:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+37:2357:x1876532858489728:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 637us (1129us total) trans 0 rc 0/0 00010000:00010000:0.0:1789601478.206162:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789601478.206166:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00925800, rc 0) 00000100:00100000:2.0:1789601478.206173:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:0.0:1789601478.206195:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+36:10407:x1876532858489600:12345-192.168.201.30@tcp:101:bash.0 Request processed in 4699us (4924us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1789601478.206211:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:1.0:1789601478.220005:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601478.220093:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858489984 00000100:00100000:3.0:1789601478.220103:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858489984 00000100:00100000:3.0:1789601478.220164:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:3.0:1789601478.220175:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+36:10407:x1876532858489984:12345-192.168.201.30@tcp:36:bash.0 00010000:00010000:3.0:1789601478.220438:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac3af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.220457:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac3af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.220472:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac3af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601478.220540:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1789601478.220573:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064e681a3 reply state 0000000028b04b08 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac3af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601478.220582:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789601478.220710:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+39:10407:x1876532858489984:12345-192.168.201.30@tcp:36:bash.0 Request processed in 536us (714us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789601478.220728:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 58 00000020:00080000:3.0:1789601478.220733:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789601478.222469:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac3af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601478.222511:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac3af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601478.222519:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac3af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601478.222525:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601478.222530:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac3af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601478.222537:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac3af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601478.222553:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:1.0:1789601478.222556:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601478.222570:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac3af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601478.222577:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac3af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601478.226137:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601478.226934:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858490112 00000100:00100000:3.0:1789601478.226947:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858490112 00000100:00100000:3.0:1789601478.227013:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:3.0:1789601478.227024:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+38:10407:x1876532858490112:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789601478.227048:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601478.227069:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac3b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50610cf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.227149:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac3bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.227164:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac3a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610c8 expref: 39 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.227173:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac3bd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.227209:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac3a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610c8 expref: 39 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.227223:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac3a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610c8 expref: 39 pid: 8248 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601478.227236:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1876532880541440:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789601478.227318:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601478.230145:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601478.230528:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858490240 00000100:00100000:1.0:1789601478.230539:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858490240 00010000:00010000:1.0:1789601478.230586:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac3a1 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610c8 expref: 40 pid: 8248 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601478.230620:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1876532880541440:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789601478.230633:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:1.0:1789601478.230644:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+40:2356:x1876532858490240:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601478.230649:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac3bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601478.230679:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601478.230687:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac3a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610c8 expref: 40 pid: 8248 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601478.230700:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac3a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610c8 expref: 40 pid: 8248 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601478.230722:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac3a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610c8 expref: 40 pid: 8248 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601478.230739:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:1.0:1789601478.230745:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac3bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601478.230755:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac3bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601478.230763:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac3bd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601478.230787:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601478.230809:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac3bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.230818:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac3bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601478.230882:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+39:2356:x1876532858490240:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 239us (745us total) trans 0 rc 0/0 00000004:00200000:2.0:1789601478.230891:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000100:00100000:1.0:1789601478.230892:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00000004:00200000:2.0:1789601478.230897:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789601478.230919:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac3bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.230954:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac3b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610cf expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.230966:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac3bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610cf expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.230971:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:2.0:1789601478.230973:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601478.230975:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadd600, rc 0) 00000100:00100000:2.0:1789601478.230995:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+38:10407:x1876532858490112:12345-192.168.201.30@tcp:101:bash.0 Request processed in 3975us (4871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601478.231000:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:1.0:1789601478.233677:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601478.233758:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858490496 00000100:00100000:0.0:1789601478.233769:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858490496 00000100:00100000:0.0:1789601478.233831:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:0.0:1789601478.233870:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91eddcdae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+38:10407:x1876532858490496:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:0.0:1789601478.234118:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91eddcdae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+39:10407:x1876532858490496:12345-192.168.201.30@tcp:35:bash.0 Request processed in 251us (448us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1789601478.234126:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:0.0:1789601478.310940:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601478.311082:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858490752 00000100:00100000:3.0:1789601478.311093:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858490752 00000100:00100000:3.0:1789601478.311156:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:3.0:1789601478.311165:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+39:10417:x1876532858490752:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601478.311186:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601478.311207:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac3c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50610d6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601478.311287:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789601478.311387:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac3c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610d6 expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.311401:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8a67100) 00010000:00010000:3.0:1789601478.311404:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601478.311410:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac3c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610d6 expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.311423:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadce00, rc 0) 00000100:00100000:3.0:1789601478.311596:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+40:10417:x1876532858490752:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 431us (667us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1789601478.311604:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:1.0:1789601478.318721:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601478.318820:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858490880 00000100:00100000:0.0:1789601478.318831:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858490880 00000100:00100000:0.0:1789601478.318918:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:0.0:1789601478.318929:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+40:10417:x1876532858490880:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:0.0:1789601478.319002:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319016:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319025:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319036:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319040:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319059:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319235:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac3e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319241:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319246:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789601478.319280:0:8248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319290:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319295:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319300:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319304:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601478.319307:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319312:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319321:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:0.0:1789601478.319328:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601478.319332:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319336:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319347:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319350:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319354:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319357:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601478.319359:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319362:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319365:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91edd0646300) 00010000:00010000:0.0:1789601478.319367:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601478.319368:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319371:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319382:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319389:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac3e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319395:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319400:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601478.319403:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319409:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac3e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319417:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:0.0:1789601478.319419:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601478.319422:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac3e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.319428:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac3e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601478.319507:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+40:10417:x1876532858490880:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 579us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601478.319516:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:1.0:1789601478.322631:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601478.323238:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858491136 00000100:00100000:0.0:1789601478.323248:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858491136 00000100:00100000:0.0:1789601478.323329:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1789601478.323337:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+40:10417:x1876532858491136:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1789601478.323597:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+41:10417:x1876532858491136:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 259us (976us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1789601478.323621:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:1.0:1789601478.362237:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601478.362356:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858491392 00000100:00100000:0.0:1789601478.362366:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858491392 00000100:00100000:0.0:1789601478.362422:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:0.0:1789601478.362434:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+41:10420:x1876532858491392:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789601478.362460:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601478.362484:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac3e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50610dd expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.362585:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.362601:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.362612:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.362626:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.362633:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.362640:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.362938:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac3fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.362953:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac3fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.362958:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac3fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601478.362970:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789601478.363053:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.363058:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.363062:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.363066:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601478.363069:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.363075:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.363083:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:0.0:1789601478.363085:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601478.363088:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.363092:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac3ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.363101:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.363109:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.363113:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.363115:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601478.363117:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.363120:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.363124:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91edd0646300) 00010000:00010000:0.0:1789601478.363126:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601478.363127:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.363130:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac3f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.363299:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac3e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610dd expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.363309:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac3fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610dd expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.363314:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:0.0:1789601478.363316:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789601478.363322:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924200, rc 0) 00000100:00100000:0.0:1789601478.363369:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+43:10420:x1876532858491392:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 939us (1149us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1789601478.363375:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:1.0:1789601478.370741:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601478.370809:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601478.370984:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858491648 00000100:00100000:0.0:1789601478.370996:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858491648 00000100:00100000:0.0:1789601478.371049:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:0.0:1789601478.371056:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+43:2357:x1876532858491648:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601478.371069:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601478.371090:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac3fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610dd expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601478.371106:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:0.0:1789601478.371109:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601478.371169:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+42:2357:x1876532858491648:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 102us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601478.371177:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:2.0:1789601478.371306:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858491520 00000100:00100000:2.0:1789601478.371311:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858491520 00000100:00100000:2.0:1789601478.371347:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:2.0:1789601478.371355:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+42:10420:x1876532858491520:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:2.0:1789601478.371422:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac40a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.371438:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac40a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.371448:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac40a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.371477:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac40a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.371484:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac40a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.371492:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac40a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.371498:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8dc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601478.371503:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac40a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.371511:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac40a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.371519:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:2.0:1789601478.371522:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789601478.371526:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac40a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.371542:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac40a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601478.371611:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+42:10420:x1876532858491520:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 257us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601478.371618:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:1.0:1789601478.375338:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601478.375387:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858491904 00000100:00100000:3.0:1789601478.375593:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858491904 00000100:00100000:3.0:1789601478.375785:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:3.0:1789601478.375796:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+42:10420:x1876532858491904:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789601478.376146:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+43:10420:x1876532858491904:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 351us (813us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789601478.376155:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:1.0:1789601478.605663:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880541568:0@lo:400:kworker.0 00000100:00100000:1.0:1789601478.605801:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601478.607280:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880541568 00000100:00100000:3.0:1789601478.607306:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880541568 00000100:00100000:3.0:1789601478.607370:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789601478.607380:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede0067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3318:x1876532880541568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601478.608780:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880541952:0@lo:400:kworker.0 00000100:00100000:2.0:1789601478.608834:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601478.608903:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880541952 00000100:00100000:2.0:1789601478.608910:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880541952 00000100:00100000:2.0:1789601478.608956:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789601478.608963:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc704b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1876532880541952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601478.609002:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc704b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1876532880541952:12345-0@lo:400:kworker.0 Request processed in 39us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601478.609008:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1789601478.609026:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601478.609055:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880541952:0@lo:400:kworker.0 00000100:00100000:2.0:1789601478.609109:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880541824:0@lo:400:kworker.0 00000100:00100000:2.0:1789601478.609136:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601478.609158:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601478.609164:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880541696:0@lo:400:kworker.0 00000100:00100000:2.0:1789601478.609184:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601478.609231:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880541824 00000100:00100000:2.0:1789601478.609235:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880541824 00000100:00080000:2.0:1789601478.609250:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601478.609282:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880541696 00000100:00100000:2.0:1789601478.609285:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880541696 00000100:00100000:2.0:1789601478.609302:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789601478.609308:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc704bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880541824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601478.609338:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc704bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880541824:12345-0@lo:400:kworker.0 Request processed in 30us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601478.609344:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789601478.609363:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880541824:0@lo:400:kworker.0 00000100:00100000:2.0:1789601478.609378:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789601478.609384:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880541696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601478.609410:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8312680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880541696:12345-0@lo:400:kworker.0 Request processed in 27us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601478.609416:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789601478.609434:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880541696:0@lo:400:kworker.0 00000100:00100000:3.0:1789601478.614961:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede0067850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3318:x1876532880541568:12345-0@lo:400:kworker.0 Request processed in 7572us (9148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601478.614976:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789601478.615154:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601478.615383:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858492160 00000100:00100000:3.0:1789601478.615392:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858492160 00000100:00100000:3.0:1789601478.615439:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:3.0:1789601478.615450:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+43:10438:x1876532858492160:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:3.0:1789601478.615472:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601478.615508:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac411 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50610e4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.615646:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac418 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.615662:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac418 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.615675:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac418 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601478.615687:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789601478.615820:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac411 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610e4 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.615874:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac418 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610e4 expref: 45 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.615898:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:3.0:1789601478.615901:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789601478.615904:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadce00, rc 0) 00000100:00100000:3.0:1789601478.615961:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8312300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+45:10438:x1876532858492160:12345-192.168.201.30@tcp:101:cat.0 Request processed in 514us (809us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789601478.615968:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:0.0:1789601478.619022:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789601478.619044:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880542208:0@lo:400:kworker.0 00000100:00100000:0.0:1789601478.619120:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601478.619166:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880542208 00000100:00100000:0.0:1789601478.619174:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880542208 00000100:00100000:0.0:1789601478.619230:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789601478.619252:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880542208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601478.619313:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880542208:12345-0@lo:400:kworker.0 Request processed in 75us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601478.619321:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1789601478.619357:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789601478.619392:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880542208:0@lo:400:kworker.0 00000100:00100000:3.0:1789601478.620644:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601478.620664:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880542080:0@lo:400:kworker.0 00000100:00100000:3.0:1789601478.620719:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601478.621053:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880542080 00000100:00100000:0.0:1789601478.621060:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880542080 00000100:00080000:2.0:1789601478.621174:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601478.621337:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789601478.621346:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880542080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601478.621406:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880542080:12345-0@lo:400:kworker.0 Request processed in 62us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601478.621413:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789601478.621637:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880542080:0@lo:400:kworker.0 00000100:00100000:1.0:1789601478.625466:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880541568:0@lo:400:kworker.0 00000100:00100000:2.0:1789601478.655807:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601478.656041:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858492288 00000100:00100000:3.0:1789601478.656052:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858492288 00000100:00100000:3.0:1789601478.656112:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:3.0:1789601478.656123:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+45:10439:x1876532858492288:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601478.656146:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601478.656170:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac426 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50610eb expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.656237:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac42d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.656253:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac42d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.656265:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac42d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601478.656316:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789601478.656320:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789601478.656339:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac42d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.656366:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac426 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610eb expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.656386:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac42d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610eb expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.656394:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:3.0:1789601478.656397:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601478.656401:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadca00, rc 0) 00000100:00100000:3.0:1789601478.656470:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+46:10439:x1876532858492288:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 349us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601478.656477:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:3.0:1789601478.666169:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601478.666269:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858492672 00000100:00100000:0.0:1789601478.666278:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858492672 00000100:00100000:0.0:1789601478.666340:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:0.0:1789601478.666350:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+46:10439:x1876532858492672:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1789601478.666698:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+47:10439:x1876532858492672:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 348us (536us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789601478.666705:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00010000:00010000:2.0:1789601478.667240:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601478.670670:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601478.670790:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858492800 00000100:00100000:3.0:1789601478.670802:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858492800 00000100:00100000:3.0:1789601478.670905:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:3.0:1789601478.670917:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8680e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+47:10439:x1876532858492800:12345-192.168.201.30@tcp:103:lfs.0 00010000:00010000:3.0:1789601478.670932:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789601478.670958:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac3bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610cf expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.670982:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac418 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610e4 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.671012:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac2c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061090 expref: 45 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.671022:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67c00) 00010000:00010000:3.0:1789601478.671034:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601478.671085:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8680e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+44:10439:x1876532858492800:12345-192.168.201.30@tcp:103:lfs.0 Request processed in 171us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601478.671092:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:3.0:1789601478.674823:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601478.675526:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858492928 00000100:00100000:2.0:1789601478.675538:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858492928 00000100:00100000:2.0:1789601478.675611:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:2.0:1789601478.675621:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+44:10439:x1876532858492928:12345-192.168.201.30@tcp:58:lfs.0 00010000:00010000:2.0:1789601478.675744:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac434 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.675772:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac434 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601478.675784:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac434 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789601478.676163:0:8248:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789601478.676350:0:8248:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1789601478.676435:0:8248:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1789601478.676761:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+44:10439:x1876532858492928:12345-192.168.201.30@tcp:58:lfs.0 Request processed in 1137us (1945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601478.676772:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:0.0:1789601478.700613:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601478.700868:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858493056 00000100:00100000:3.0:1789601478.700880:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858493056 00000100:00100000:3.0:1789601478.700943:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:3.0:1789601478.700954:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+44:10441:x1876532858493056:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601478.700975:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601478.700996:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac43b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50610f2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701062:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac442 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701078:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac442 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701107:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac442 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701125:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac449 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701133:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac449 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701140:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac449 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701369:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac450 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701378:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701386:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601478.701502:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789601478.701507:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789601478.701528:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701540:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac450 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701561:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac442 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701579:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac442 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701586:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac442 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701593:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadd600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601478.701598:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac442 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701605:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac442 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701617:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:3.0:1789601478.701620:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601478.701625:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac442 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701630:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac442 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701643:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac449 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701649:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac449 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701655:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac449 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701660:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601478.701669:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac449 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701794:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac449 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701803:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91edd8ce5700) 00010000:00010000:3.0:1789601478.701806:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601478.701809:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac449 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.701815:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac449 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.702077:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac43b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610f2 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.702093:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac450 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610f2 expref: 45 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601478.702101:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67400) 00010000:00010000:3.0:1789601478.702104:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601478.702107:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc400, rc 0) 00000100:00100000:3.0:1789601478.702178:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+45:10441:x1876532858493056:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1225us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601478.702185:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:2.0:1789601479.115879:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601479.115912:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edfff66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880542336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601479.116007:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601479.116221:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880542336 00000100:00100000:1.0:1789601479.116231:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880542336 00000100:00100000:1.0:1789601479.116300:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789601479.116310:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880542336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601479.116348:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601479.116404:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880542336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601479.116411:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789601479.118246:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edfff66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880542336:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1789601479.242997:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789601479.243010:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789601479.243084:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789601479.243091:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789601479.243230:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002eb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1876532880542464:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789601479.243321:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604240 going to sleep for 11 seconds 00000100:00100000:0.0:1789601479.248212:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601479.248320:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858493184 00000100:00100000:2.0:1789601479.248330:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858493184 00000100:00100000:2.0:1789601479.248394:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:2.0:1789601479.248404:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+46:10452:x1876532858493184:12345-192.168.201.30@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789601479.248484:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+46:10452:x1876532858493184:12345-192.168.201.30@tcp:900:lhsmtool_posix.0 Request processed in 82us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601479.248492:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00080000:0.0:1789601479.248823:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601479.249104:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002eb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1876532880542464:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789601479.259104:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601479.259248:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858493312 00000100:00100000:1.0:1789601479.259259:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858493312 00000100:00100000:1.0:1789601479.259331:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:1.0:1789601479.259342:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+45:10452:x1876532858493312:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789601479.259377:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789601479.259489:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+45:10452:x1876532858493312:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 149us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601479.259497:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:1.0:1789601479.263624:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601479.265002:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858493440 00000100:00100000:3.0:1789601479.265017:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858493440 00000100:00100000:3.0:1789601479.265100:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:3.0:1789601479.265111:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+45:10452:x1876532858493440:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789601479.265187:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac457 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265205:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac457 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265218:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac457 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265236:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac45e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265244:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac45e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265251:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac45e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265278:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac465 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265287:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265312:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601479.265356:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789601479.265361:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789601479.265379:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265392:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac457 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265399:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac457 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265406:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac457 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265412:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadce00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601479.265416:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac457 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265423:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac457 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265435:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91edd35e8700) 00010000:00010000:3.0:1789601479.265438:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601479.265443:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac457 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265449:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac457 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265474:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac45e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265479:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac45e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265485:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac45e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265490:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601479.265493:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac45e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265499:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac45e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265506:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff91edd8ce5700) 00010000:00010000:3.0:1789601479.265509:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601479.265512:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac45e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265518:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac45e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265532:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265538:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac465 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265554:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265565:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadd600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601479.265568:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265575:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac465 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265583:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67400) 00010000:00010000:3.0:1789601479.265585:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601479.265589:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac465 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.265594:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac465 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601479.266394:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+45:10452:x1876532858493440:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 Request processed in 1279us (2778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601479.266405:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:0.0:1789601479.274638:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601479.275120:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858493696 00000100:00100000:3.0:1789601479.275130:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858493696 00000100:00100000:3.0:1789601479.275222:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:3.0:1789601479.275232:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+45:10452:x1876532858493696:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789601479.275250:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601479.275270:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac46c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50610f9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.275361:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac473 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.275392:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac473 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.275404:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac473 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601479.275418:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789601479.275519:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac473 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.275527:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac473 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.275534:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac473 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.275553:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601479.275558:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac473 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.275567:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac473 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.275579:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67400) 00010000:00010000:3.0:1789601479.275583:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601479.275588:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac473 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.275595:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac473 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.275638:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac46c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610f9 expref: 47 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.275655:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91edd35e8700) 00010000:00010000:3.0:1789601479.275657:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601479.275737:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac46c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610f9 expref: 47 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.275753:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffaddc00, rc 0) 00000100:00100000:3.0:1789601479.275824:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+46:10452:x1876532858493696:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 593us (1193us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1789601479.275832:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:0.0:1789601479.285997:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601479.286122:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858493824 00000100:00100000:3.0:1789601479.286133:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858493824 00000100:00100000:3.0:1789601479.286189:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:3.0:1789601479.286201:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+46:10452:x1876532858493824:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789601479.286236:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789601479.287067:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+46:10452:x1876532858493824:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 865us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601479.287078:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:1.0:1789601479.315977:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601479.317073:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858494080 00000100:00100000:2.0:1789601479.317085:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858494080 00000100:00100000:2.0:1789601479.317144:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:2.0:1789601479.317153:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+46:10452:x1876532858494080:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601479.317172:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601479.317175:0:8248:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789601479.317200:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac42d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610eb expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601479.317216:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:2.0:1789601479.317226:0:8248:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601479.317239:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac481 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061100 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789601479.317755:0:8248:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789601479.319275:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac488 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601479.319292:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601479.319304:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601479.319362:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac481 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061100 expref: 48 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601479.319381:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac488 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061100 expref: 47 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601479.319389:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91edd8a67600) 00010000:00010000:2.0:1789601479.319392:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601479.319462:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8c800, rc 0) 00000100:00100000:2.0:1789601479.319538:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+47:10452:x1876532858494080:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 2385us (3580us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789601479.319576:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:0.0:1789601479.331428:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601479.331549:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858494336 00000100:00100000:3.0:1789601479.331560:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858494336 00000100:00100000:3.0:1789601479.331625:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:3.0:1789601479.331636:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+47:10452:x1876532858494336:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789601479.331707:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601479.331733:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac488 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061100 expref: 47 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.335981:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91edd8a67600) 00010000:00010000:3.0:1789601479.335996:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601479.336030:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac496 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.336047:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac496 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.336059:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac496 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.336113:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac49d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc916a317 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.336122:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac49d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc916a317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.336129:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac49d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc916a317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.336344:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac496 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.336353:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac496 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.336359:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac496 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.336366:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffaddc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601479.336371:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac496 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.336387:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac496 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.336412:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:3.0:1789601479.336416:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601479.336421:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac496 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.336428:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac496 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.336440:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac49d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc916a317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.336446:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac49d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc916a317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.336453:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac49d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc916a317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.336458:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601479.336461:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac49d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc916a317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.336467:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac49d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc916a317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.336475:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc916a317 (ffff91edd8ce5700) 00010000:00010000:3.0:1789601479.336478:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601479.336481:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac49d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc916a317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.336497:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac49d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc916a317 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601479.336638:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+46:10452:x1876532858494336:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 4998us (5214us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789601479.336649:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:0.0:1789601479.344265:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601479.346476:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858494464 00000100:00100000:3.0:1789601479.346490:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858494464 00000100:00100000:3.0:1789601479.346566:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00100000:3.0:1789601479.346577:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+46:10452:x1876532858494464:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789601479.346601:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601479.346637:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac4a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061107 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.347084:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac4ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.347101:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac4ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.347114:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac4ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.347213:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac4a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061107 expref: 48 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.347232:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac4ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061107 expref: 47 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.347254:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91edd8ce5800) 00010000:00010000:3.0:1789601479.347257:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789601479.347262:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc600, rc 0) 00000100:00100000:3.0:1789601479.347328:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+47:10452:x1876532858494464:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 753us (3074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601479.347337:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00100000:2.0:1789601479.351951:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601479.352616:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858494720 00000100:00100000:3.0:1789601479.352632:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858494720 00000100:00100000:3.0:1789601479.352728:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00100000:3.0:1789601479.352740:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+47:10452:x1876532858494720:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789601479.352885:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.352905:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.352917:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789601479.353315:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1789601479.353325:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 349391487221ns, next at 350391485257ns, rc = 0 00000004:00010000:3.0:1789601479.353718:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000855e4877 reply state 0000000069805500 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601479.353730:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789601479.354215:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+49:10452:x1876532858494720:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 1474us (2273us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1789601479.354241:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00100000:0.0:1789601479.363784:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601479.363822:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858494848 00000100:00100000:0.0:1789601479.363871:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858494848 00000100:00100000:0.0:1789601479.363922:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:0.0:1789601479.363933:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+49:10452:x1876532858494848:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601479.363962:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601479.363995:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac4b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506110e expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.364057:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac4b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506110e expref: 50 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.364073:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac4b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506110e expref: 50 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.364091:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91edd8ce5800) 00010000:00010000:0.0:1789601479.364095:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789601479.364099:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00925a00, rc 0) 00000100:00100000:0.0:1789601479.364158:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+50:10452:x1876532858494848:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 226us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601479.364165:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 76 00010000:00010000:3.0:1789601479.366356:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.366376:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.366385:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.366392:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601479.366408:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.366419:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.366437:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91edd8ce5800) 00010000:00010000:3.0:1789601479.366440:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789601479.366445:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.366451:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601479.370343:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601479.370534:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858494976 00000100:00100000:0.0:1789601479.370557:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858494976 00000100:00100000:0.0:1789601479.370606:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:0.0:1789601479.370616:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2355:x1876532858494976:12345-192.168.201.30@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1789601479.370675:0:11670:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp t0 exp 0000000000000000 cur 349 last 0 00000020:00000080:0.0:1789601479.370713:0:11670:0:(genops.c:1384:class_connect()) connect: client 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6, cookie 0xf3d6e402158ac4c0 00002000:00100000:0.0:1789601479.370725:0:11670:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6/ffff91edc2a52800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789601479.370744:0:11670:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789601479.371261:0:11670:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789601479.371293:0:11670:0:(import.c:65:import_set_state_nolock()) ffff91edf9db7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601479.371369:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2355:x1876532858494976:12345-192.168.201.30@tcp:8:lhsmtool_posix.0 Request processed in 753us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601479.371378:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:2.0:1789601479.381732:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601479.381823:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858495104 00000100:00100000:3.0:1789601479.381873:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858495104 00000100:00100000:3.0:1789601479.381934:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:3.0:1789601479.381943:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:0:x1876532858495104:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789601479.382303:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789601479.458338:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:0:x1876532858495104:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 76386us (76608us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789601479.458353:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000001:00100000:3.0:1789601479.458535:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 00000001:00080000:3.0:1789601479.458584:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1789601479.468222:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601479.468311:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858495360 00000100:00100000:0.0:1789601479.468322:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858495360 00000100:00100000:0.0:1789601479.468391:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:0.0:1789601479.468403:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+49:10452:x1876532858495360:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789601479.468671:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+50:10452:x1876532858495360:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 270us (458us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789601479.468679:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:0.0:1789601479.473768:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601479.473920:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858495616 00000100:00100000:3.0:1789601479.473933:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858495616 00000100:00100000:3.0:1789601479.473994:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:3.0:1789601479.474005:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+50:10452:x1876532858495616:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789601479.474135:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+50:10452:x1876532858495616:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 131us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601479.474143:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:2.0:1789601479.479089:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601479.479253:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858495744 00000100:00100000:0.0:1789601479.479263:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858495744 00000100:00100000:0.0:1789601479.479323:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:0.0:1789601479.479333:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+50:10452:x1876532858495744:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601479.479354:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601479.479374:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac4c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061115 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.479467:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac4ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.479500:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac4ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.479513:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac4ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601479.479562:0:8248:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789601479.479582:0:8248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac4ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.479607:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac4c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061115 expref: 52 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.479624:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac4ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061115 expref: 51 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.479633:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91edd8ce5800) 00010000:00010000:0.0:1789601479.479636:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789601479.479640:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924200, rc 0) 00000100:00100000:0.0:1789601479.479710:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+51:10452:x1876532858495744:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 378us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601479.479717:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:0.0:1789601479.498262:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601479.498346:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858495872 00000100:00100000:2.0:1789601479.498357:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858495872 00000100:00100000:2.0:1789601479.498416:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:2.0:1789601479.498427:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2357:x1876532858495872:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601479.498449:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601479.498474:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b18cfa36/0xf3d6e402158ac4d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506111c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789601479.498502:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab26c8, blocks: 0x1 00010000:00010000:2.0:1789601479.498521:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1789601479.498526:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601479.498534:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b18cfa36/0xf3d6e402158ac4d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506111c expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601479.498568:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b18cfa36/0xf3d6e402158ac4d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506111c expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601479.498582:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8cc00, rc 0) 00000100:00100000:2.0:1789601479.498643:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858495872:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 219us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601479.498650:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:3.0:1789601479.517883:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601479.517918:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858496128 00000100:00100000:3.0:1789601479.517927:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858496128 00000100:00100000:3.0:1789601479.517974:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:3.0:1789601479.517984:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+51:10452:x1876532858496128:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789601479.521943:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+51:10452:x1876532858496128:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 98us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601479.521970:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:3.0:1789601479.542487:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601479.542572:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858496256 00000100:00100000:1.0:1789601479.542584:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858496256 00000100:00100000:1.0:1789601479.542650:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:1.0:1789601479.542671:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:10452:x1876532858496256:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601479.542690:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601479.542715:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158ac4dc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061123 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.542749:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b18cfa36/0xf3d6e402158ac4d5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506111c expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.542759:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601479.542764:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601479.542769:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158ac4dc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061123 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.542809:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b18cfa36/0xf3d6e402158ac4d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506111c expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.542825:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b18cfa36/0xf3d6e402158ac4d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506111c expref: 7 pid: 6677 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601479.542861:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edfff65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876532880542592:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789601479.542950:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64900 going to sleep for 11 seconds 00000100:00100000:0.0:1789601479.547791:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edfff65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876532880542592:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789601479.547829:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158ac4dc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061123 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.547900:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b89000, rc 0) 00000100:00100000:0.0:1789601479.547953:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:10452:x1876532858496256:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 5292us (5473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601479.547962:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:1.0:1789601479.559806:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601479.570620:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858496384 00000100:00100000:0.0:1789601479.570638:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858496384 00010000:00010000:0.0:1789601479.571817:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b18cfa36/0xf3d6e402158ac4d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506111c expref: 7 pid: 6677 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601479.571884:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:0.0:1789601479.571898:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede51e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2357:x1876532858496384:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601479.571915:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601479.571941:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b18cfa36/0xf3d6e402158ac4d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506111c expref: 7 pid: 6677 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.571958:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b18cfa36/0xf3d6e402158ac4d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506111c expref: 7 pid: 6677 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.571983:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b18cfa36/0xf3d6e402158ac4d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506111c expref: 7 pid: 6677 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.572001:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601479.572006:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601479.572015:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158ac4dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061123 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.572032:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158ac4dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061123 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.572073:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158ac4dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061123 expref: 6 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601479.572088:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8682d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1876532880542720:192.168.201.30@tcp:105: 00000100:00100000:0.0:1789601479.572172:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffc97840 going to sleep for 11 seconds 00000100:00100000:1.0:1789601479.580206:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601479.580316:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8682d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1876532880542720:192.168.201.30@tcp:105: 00010000:00010000:0.0:1789601479.580343:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601479.580398:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede51e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858496384:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 8503us (20602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601479.580410:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:2.0:1789601479.584548:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858496512 00000100:00100000:2.0:1789601479.584571:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858496512 00002000:00100000:2.0:1789601479.584644:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff91edfff64a80 x1876532858496512/t0(0) o4->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:75/0 lens 504/0 e 0 to 0 dl 1789601490 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789601479.584728:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91edfff64a80 with x1876532858496512 ext(0->8) 00002000:00010000:2.0:1789601479.584740:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91edfff64a80 00000100:00100000:2.0:1789601479.584771:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:2.0:1789601479.584781:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858496512:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789601479.587969:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2357:x1876532858496512:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 Request processed in 3182us (7765us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789601479.587984:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00002000:00100000:2.0:1789601479.587996:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff91edfff64a80 x1876532858496512/t4294967302(0) o4->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:75/0 lens 504/448 e 0 to 0 dl 1789601490 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789601479.588006:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91edfff64a80 with x1876532858496512 ext(0->8) 00002000:00010000:2.0:1789601479.588012:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91edfff64a80 00000100:00100000:3.0:1789601479.591071:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601479.601713:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858496640 00000100:00100000:0.0:1789601479.601734:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858496640 00000100:00100000:1.0:1789601479.603741:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:1.0:1789601479.603905:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+51:10452:x1876532858496640:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 00000040:00080000:1.0:1789601479.647337:0:11981:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601479.647347:0:11981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601479.647387:0:11981:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789601479.647931:0:11981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1789601479.677304:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1789601479.677371:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:2.0:1789601479.677520:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1789601479.677551:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91edc8968e40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789601479.677557:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91ee00ad9100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91edc5386900 00000020:00080000:2.0:1789601479.677560:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91ee00ad9800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91edf7e7e000 00000020:00080000:2.0:1789601479.677594:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:1.0:1789601479.678371:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:10452:x1876532858496640:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 Request processed in 74484us (87302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601479.678383:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:3.0:1789601479.685119:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880542848:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789601479.685210:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601479.685445:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601479.685474:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880542848 00000100:00100000:3.0:1789601479.685483:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880542848 00000100:00100000:3.0:1789601479.685525:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858496768 00000100:00100000:3.0:1789601479.685528:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858496768 00000100:00100000:3.0:1789601479.685562:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789601479.685597:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880542848:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789601479.685866:0:11670:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789601479.685870:0:11670:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789601480 00002000:00010000:3.0:1789601479.685873:0:11670:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789601479.685875:0:11670:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789601480 -> 1789601480 00002000:00010000:3.0:1789601479.685878:0:11670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789601479.685925:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3317:x1876532880542848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 330us (714us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789601479.685934:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789601479.685955:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:3.0:1789601479.685962:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2356:x1876532858496768:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1789601479.686041:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91edf8680e00/2, rc 0, transno 4294967303 00000100:00100000:3.0:1789601479.686048:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880542848:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789601479.686143:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601479.686150:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880542976:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789601479.686178:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601479.686201:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880542976 00000100:00100000:3.0:1789601479.686205:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880542976 00000100:00100000:3.0:1789601479.686228:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789601479.686235:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1876532880542976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789601479.686250:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1789601479.686278:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aab26c4, atime: 0x6aab26c5, ctime: 0x6aab26c4, blocks: 0xb 00010000:00010000:3.0:1789601479.686287:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac72d774/0xf3d6e402158ac4e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.686304:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=349s v=(0 0) 00010000:00010000:3.0:1789601479.686316:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601479.686323:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac72d774/0xf3d6e402158ac4e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.686340:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac72d774/0xf3d6e402158ac4e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.686352:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac72d774/0xf3d6e402158ac4e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.686360:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac72d774/0xf3d6e402158ac4e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.686379:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789601479.686867:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3317:x1876532880542976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 631us (687us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789601479.686874:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:3.0:1789601479.686906:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91ee002eb800/2, rc 0, transno 4294967301 00000100:00100000:3.0:1789601479.686911:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880542976:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1789601479.692278:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:2.0:1789601479.692296:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601479.692307:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac72d774/0xf3d6e402158ac4e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601479.692322:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadd600 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601479.692328:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac72d774/0xf3d6e402158ac4e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601479.692360:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac72d774/0xf3d6e402158ac4e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601479.692382:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac72d774/0xf3d6e402158ac4e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601479.692389:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac72d774/0xf3d6e402158ac4e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601479.692414:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601479.692416:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601479.692417:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601479.694940:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789601479.829813:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1789601479.829866:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1789601479.830611:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858496768:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 Request processed in 144640us (145158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601479.830625:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:1.0:1789601479.836300:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601479.836875:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858497024 00000100:00100000:3.0:1789601479.836892:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858497024 00000100:00100000:3.0:1789601479.836958:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:3.0:1789601479.836969:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:10452:x1876532858497024:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789601479.837058:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601479.837093:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac4ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061115 expref: 13 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.837115:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91edd8ce5800) 00010000:00010000:3.0:1789601479.837120:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601479.837154:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.837168:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.837180:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601479.837470:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044738304 reply state 00000000fb370fcf transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601479.837480:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789601479.837596:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:10452:x1876532858497024:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 628us (1310us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789601479.837802:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:0.0:1789601479.850714:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601479.850795:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858497152 00000100:00100000:2.0:1789601479.850806:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858497152 00000100:00100000:2.0:1789601479.850895:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:2.0:1789601479.850907:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858497152:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789601479.851176:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789601479.851181:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789601480 -> 1789601479 00002000:00010000:2.0:1789601479.851184:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789601477 00002000:00010000:2.0:1789601479.851187:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789601480 -> 1789601479 00002000:00010000:2.0:1789601479.851189:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789601479.851248:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2357:x1876532858497152:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 343us (599us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789601479.851256:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 31 00010000:00010000:1.0:1789601479.851834:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.851888:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.851897:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.851903:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601479.851908:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.851916:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.851933:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91edd8ce5800) 00010000:00010000:1.0:1789601479.851950:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601479.851956:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.851962:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac4ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601479.859000:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601479.859095:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858497408 00000100:00100000:1.0:1789601479.859105:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858497408 00000100:00100000:1.0:1789601479.859158:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:1.0:1789601479.859167:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:10452:x1876532858497408:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789601479.859250:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.859270:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac4ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061107 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.859279:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4f1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.859312:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac4ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061107 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.859325:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac4ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061107 expref: 13 pid: 5839 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601479.859338:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edfff67b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1876532880543104:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789601479.865643:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64300 going to sleep for 11 seconds 00000100:00100000:0.0:1789601479.875170:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601479.875900:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edfff67b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1876532880543104:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601479.875933:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601479.875971:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858497536 00000100:00100000:3.0:1789601479.875980:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858497536 00010000:00010000:3.0:1789601479.876025:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac4ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061107 expref: 14 pid: 5839 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601479.876087:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:3.0:1789601479.876097:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8682a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:2357:x1876532858497536:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601479.876114:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601479.876121:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac4ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061107 expref: 14 pid: 5839 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.876133:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac4ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061107 expref: 14 pid: 5839 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.876156:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac4ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061107 expref: 14 pid: 5839 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.876174:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91edd8ce5800) 00010000:00010000:3.0:1789601479.876178:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.876190:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.876198:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.876223:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601479.876273:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8682a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:2357:x1876532858497536:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 178us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601479.876281:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 43 00010000:00010000:3.0:1789601479.876305:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.876317:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.876349:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.876356:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.876363:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.876369:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601479.876373:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.876381:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.876389:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91edd8ce5800) 00010000:00010000:3.0:1789601479.876392:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789601479.876396:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.876402:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601479.876442:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+12:10452:x1876532858497408:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 Request processed in 17276us (17457us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789601479.876449:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:2.0:1789601479.895855:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601479.897815:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858497664 00000100:00100000:1.0:1789601479.897877:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858497664 00000100:00100000:1.0:1789601479.897964:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:1.0:1789601479.897976:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefeb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2356:x1876532858497664:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789601479.898027:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000043d9ab07/0xf3d6e402158ac4f8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.898049:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158ac4dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061123 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.898059:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601479.898065:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601479.898070:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043d9ab07/0xf3d6e402158ac4f8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.898111:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158ac4dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061123 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.898125:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158ac4dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061123 expref: 7 pid: 6676 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601479.898141:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edfff67b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1876532880543232:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789601479.898246:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601479.921763:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edfff67b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1876532880543232:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601479.921801:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000043d9ab07/0xf3d6e402158ac4f8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601479.923438:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601479.929901:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858497792 00000100:00100000:1.0:1789601479.929922:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858497792 00010000:00010000:1.0:1789601479.929990:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158ac4dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061123 expref: 8 pid: 6676 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601479.930061:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:1.0:1789601479.930074:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2356:x1876532858497792:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601479.930094:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601479.930121:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158ac4dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061123 expref: 8 pid: 6676 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.930136:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158ac4dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061123 expref: 8 pid: 6676 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.930162:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158ac4dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061123 expref: 8 pid: 6676 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.930184:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601479.930190:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601479.930197:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043d9ab07/0xf3d6e402158ac4f8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.930208:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043d9ab07/0xf3d6e402158ac4f8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.930240:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601479.930307:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2356:x1876532858497792:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 235us (6879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601479.930314:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 44 00010000:00010000:3.0:1789601479.941148:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000043d9ab07/0xf3d6e402158ac4f8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.941174:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043d9ab07/0xf3d6e402158ac4f8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.941219:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000043d9ab07/0xf3d6e402158ac4f8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.941230:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043d9ab07/0xf3d6e402158ac4f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.941239:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043d9ab07/0xf3d6e402158ac4f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.941248:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88c00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601479.941254:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043d9ab07/0xf3d6e402158ac4f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.941264:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043d9ab07/0xf3d6e402158ac4f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.941308:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043d9ab07/0xf3d6e402158ac4f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.941317:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043d9ab07/0xf3d6e402158ac4f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601479.941437:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefeb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858497664:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 Request processed in 43458us (45600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601479.941447:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:3.0:1789601479.946309:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601479.946409:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858498048 00000100:00100000:1.0:1789601479.946423:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858498048 00000100:00100000:1.0:1789601479.946509:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 83 00000100:00100000:1.0:1789601479.946521:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+12:10452:x1876532858498048:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789601479.946640:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.946668:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.946682:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.946946:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac506 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.946958:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac4b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506110e expref: 13 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.946966:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac506 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.946999:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac4b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506110e expref: 13 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.947013:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac4b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506110e expref: 13 pid: 8248 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601479.947028:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edfff67480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1876532880543360:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789601479.947124:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64000 going to sleep for 11 seconds 00000100:00100000:1.0:1789601479.974308:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601479.974342:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858498176 00000100:00100000:1.0:1789601479.974351:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858498176 00010000:00010000:1.0:1789601479.974396:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac4b9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506110e expref: 14 pid: 8248 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601479.974435:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:1.0:1789601479.974445:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:2356:x1876532858498176:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601479.974461:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601479.974468:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac4b9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506110e expref: 14 pid: 8248 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.974482:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac4b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506110e expref: 14 pid: 8248 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.974507:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91edd8ce5800) 00010000:00010000:1.0:1789601479.974513:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac506 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.974522:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac506 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.974539:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac506 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601479.974558:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601479.974624:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:2356:x1876532858498176:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 180us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601479.974631:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00010000:00010000:3.0:1789601479.975266:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158ac4b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506110e expref: 13 pid: 8248 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601479.975285:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edfff67480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1876532880543360:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601479.975306:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac506 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.975316:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac506 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601479.975322:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac506 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601479.975539:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1789601479.976162:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1789601479.976229:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1789601479.976316:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1876532880543488:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789601479.976395:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601479.976436:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7e36840 going to sleep for 11 seconds 00000100:00100000:0.0:1789601479.976925:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880543488 00000100:00100000:0.0:1789601479.976934:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880543488 00000100:00100000:0.0:1789601479.976990:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789601479.976998:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1876532880543488:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789601479.977081:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1876532880543488:12345-0@lo:1000:mdt00_000.0 Request processed in 84us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601479.977089:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789601479.977141:0:5837:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1789601479.977147:0:5837:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91edf8680e00, transno 4294967303 00000100:00100000:0.0:1789601479.977160:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1876532880543488:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789601479.980622:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1789601479.980727:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8682300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1876532880543616:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789601479.980809:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601479.980869:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffc970c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601479.980965:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880543616 00000100:00100000:1.0:1789601479.980976:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880543616 00000100:00100000:1.0:1789601479.981042:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601479.981053:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5837:x1876532880543616:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789601479.981269:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5837:x1876532880543616:12345-0@lo:1000:mdt00_000.0 Request processed in 218us (458us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789601479.981277:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789601479.983449:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8682300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1876532880543616:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789601479.983494:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac506 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.983505:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac506 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.983513:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac506 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.983519:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601479.983524:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac506 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.983545:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac506 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.983560:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91edd8ce5800) 00010000:00010000:0.0:1789601479.983564:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789601479.983570:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac506 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.983586:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ac506 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.983634:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac434 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.983641:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac434 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.983646:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac434 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.983651:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8dc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601479.983655:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac434 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.983661:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac434 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.983668:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67400) 00010000:00010000:0.0:1789601479.983671:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789601479.983674:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac434 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.983680:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac434 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.983701:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac50d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.983716:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac450 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610f2 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.983726:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac50d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.983767:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac450 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610f2 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601479.983781:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac450 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610f2 expref: 16 pid: 5838 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601479.983796:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8680a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1876532880543744:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789601479.983902:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffc970c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601480.009769:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601480.010216:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8680a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1876532880543744:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601480.010246:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac50d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601480.010330:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858498304 00000100:00100000:1.0:1789601480.010338:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858498304 00010000:00010000:1.0:1789601480.010377:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac450 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610f2 expref: 17 pid: 5838 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601480.010420:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:1.0:1789601480.010429:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8680e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+17:2357:x1876532858498304:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601480.010445:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601480.010452:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac450 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610f2 expref: 17 pid: 5838 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010465:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac450 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610f2 expref: 17 pid: 5838 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010489:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac450 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50610f2 expref: 17 pid: 5838 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010504:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67400) 00010000:00010000:1.0:1789601480.010510:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac50d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010548:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac50d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010556:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac50d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010581:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601480.010663:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8680e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+16:2357:x1876532858498304:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 234us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601480.010670:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 46 00010000:00010000:1.0:1789601480.010780:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac50d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010788:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac50d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010801:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac50d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010807:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac50d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010813:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac50d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010819:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601480.010824:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac50d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010831:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac50d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010876:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67400) 00010000:00010000:1.0:1789601480.010879:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601480.010883:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac50d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010888:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac50d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010900:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010905:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010910:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010915:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601480.010917:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010923:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010929:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8a67400) 00010000:00010000:1.0:1789601480.010931:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789601480.010934:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.010939:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac4ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601480.011194:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+15:10452:x1876532858498048:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 64675us (64896us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1789601480.011202:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 83 00000020:00080000:1.0:1789601480.011206:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789601480.011303:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789601480.011308:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789601480.011332:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789601480.011340:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789601480.015977:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601480.016336:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858498560 00000100:00100000:3.0:1789601480.016347:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858498560 00000100:00100000:3.0:1789601480.016399:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:3.0:1789601480.016409:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+15:10452:x1876532858498560:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789601480.018299:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789601480.018874:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1789601480.018952:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac514 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601480.018970:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac514 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601480.018983:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac514 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601480.018992:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac514 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601480.018999:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac514 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601480.019007:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac514 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601480.019032:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789601480.019903:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601480.019916:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac514 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.019926:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc600 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601480.019931:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac514 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.019940:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac514 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.019956:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:1.0:1789601480.019960:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789601480.019965:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac514 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601480.019974:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601480.019975:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601480.019977:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601480.020241:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac514 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601480.020398:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+17:10452:x1876532858498560:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 3984us (4425us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1789601480.020409:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000020:00080000:3.0:1789601480.020416:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789601480.713417:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601481.173685:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601481.173727:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601481.173760:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601481.173781:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601481.173804:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601481.173832:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858498816 00000100:00100000:3.0:1789601481.173862:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858498816 00000100:00100000:3.0:1789601481.173938:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858499200 00000100:00100000:3.0:1789601481.173942:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858499200 00000100:00100000:3.0:1789601481.173977:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 148 00000100:00100000:3.0:1789601481.173999:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+17:2356:x1876532858498816:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601481.174083:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+17:2356:x1876532858498816:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 95us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601481.174090:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 148 00000100:00100000:3.0:1789601481.174109:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 149 00000100:00100000:3.0:1789601481.174116:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9da8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858499200:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601481.174141:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9da8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85db4f7d-704a-4080-a137-b2930e072a8c+5:2356:x1876532858499200:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601481.174147:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 149 00000100:00100000:3.0:1789601481.174166:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858499072 00000100:00100000:3.0:1789601481.174185:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858499072 00000100:00100000:3.0:1789601481.174215:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858498944 00000100:00100000:3.0:1789601481.174218:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858498944 00000100:00100000:3.0:1789601481.174239:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:3.0:1789601481.174245:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858499072:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601481.174273:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858499072:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601481.174279:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:3.0:1789601481.174295:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:3.0:1789601481.174302:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9da9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2356:x1876532858498944:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601481.174325:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9da9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2356:x1876532858498944:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601481.174331:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:3.0:1789601481.174352:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858498688 00000100:00100000:3.0:1789601481.174357:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858498688 00000100:00100000:3.0:1789601481.174379:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 290 00000100:00100000:3.0:1789601481.174386:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2356:x1876532858498688:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601481.174408:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2356:x1876532858498688:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601481.174414:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 290 00000100:00080000:3.0:1789601481.174462:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789601481.174466:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789601481.174469:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789601481.230477:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:0.0:1789601481.230496:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1789601481.681058:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601481.681090:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edfff65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880543872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601481.681185:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601481.681259:0:10225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880543872 00000100:00100000:1.0:1789601481.681268:0:10225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880543872 00000100:00100000:1.0:1789601481.681336:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789601481.681344:0:10225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880543872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601481.681386:0:10225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601481.681432:0:10225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880543872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601481.681439:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1789601481.681462:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601481.681517:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1789601481.681524:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1789601481.681549:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91ee002eb800, transno 4294967301 00000100:00100000:1.0:1789601481.681566:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edfff65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880543872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789601481.738046:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789601481.888293:0:12033:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789601481.888302:0:12033:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789601481.888339:0:12033:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789601481.888357:0:12033:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789601482.055708:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601482.055813:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858499456 00000100:00100000:0.0:1789601482.055824:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858499456 00000100:00100000:0.0:1789601482.055907:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:0.0:1789601482.055917:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+17:10471:x1876532858499456:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789601482.055938:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601482.055960:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158ac51b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506112a expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.056053:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac522 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.056079:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac522 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.056092:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac522 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601482.056104:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789601482.056246:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158ac51b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506112a expref: 20 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.056264:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac522 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506112a expref: 19 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.056274:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:0.0:1789601482.056277:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789601482.056281:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924e00, rc 0) 00000100:00100000:0.0:1789601482.056336:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:10471:x1876532858499456:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 421us (640us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1789601482.056343:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:0.0:1789601482.073392:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601482.073568:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858499584 00000100:00100000:1.0:1789601482.073579:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858499584 00000100:00100000:1.0:1789601482.073639:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 85 00000100:00100000:1.0:1789601482.073650:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:10471:x1876532858499584:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:1.0:1789601482.073735:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ac530 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.073755:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ac530 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.073766:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ac530 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.073783:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac537 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.073790:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.073809:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074074:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac53e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074082:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac53e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074090:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac53e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789601482.074130:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac53e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074143:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ac530 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074149:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ac530 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074169:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ac530 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074176:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601482.074180:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ac530 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074187:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ac530 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074199:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:1.0:1789601482.074206:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601482.074212:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ac530 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074218:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ac530 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074230:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074235:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac537 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074241:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac537 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074245:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601482.074248:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac537 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074254:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac537 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074260:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91edd35e8200) 00010000:00010000:1.0:1789601482.074262:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601482.074265:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac537 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074271:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac537 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074283:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac53e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074292:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac53e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074298:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac53e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074303:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601482.074306:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac53e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074311:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac53e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074317:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:1.0:1789601482.074319:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601482.074322:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac53e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.074327:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac53e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601482.074400:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:10471:x1876532858499584:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 752us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601482.074408:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 85 00000100:00100000:0.0:1789601482.138949:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601482.139083:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858499840 00000100:00100000:3.0:1789601482.139094:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858499840 00000100:00100000:3.0:1789601482.139161:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:3.0:1789601482.139172:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:10474:x1876532858499840:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601482.139194:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601482.139215:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac545 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061131 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139294:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac54c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139311:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac54c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139326:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac54c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139343:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac553 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139350:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139356:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139655:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac55a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139665:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac55a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139683:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac55a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601482.139694:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789601482.139793:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac54c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139801:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac54c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139808:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac54c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139815:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffaddc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601482.139820:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac54c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139828:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac54c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139869:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:3.0:1789601482.139873:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601482.139878:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac54c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139885:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac54c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139900:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139906:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac553 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139918:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139923:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadce00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601482.139926:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139933:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac553 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139941:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91edd8ce5400) 00010000:00010000:3.0:1789601482.139943:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601482.139946:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac553 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139952:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac553 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.139996:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac545 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061131 expref: 22 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.140011:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac55a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061131 expref: 21 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.140019:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:3.0:1789601482.140022:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601482.140024:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc200, rc 0) 00000100:00100000:3.0:1789601482.140096:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:10474:x1876532858499840:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 926us (1156us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789601482.140112:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:1.0:1789601482.145176:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601482.145316:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858499968 00000100:00100000:3.0:1789601482.145327:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858499968 00000100:00100000:3.0:1789601482.145428:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 87 00000100:00100000:3.0:1789601482.145440:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:10474:x1876532858499968:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:3.0:1789601482.145528:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac568 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.145547:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.145560:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.145585:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac568 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.145593:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac568 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.145600:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac568 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.145607:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc400 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601482.145623:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac568 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.145631:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac568 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.145644:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:3.0:1789601482.145662:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601482.145669:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac568 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.145676:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac568 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601482.145759:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:10474:x1876532858499968:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 321us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601482.145767:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 87 00000100:00100000:0.0:1789601482.155913:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601482.156052:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858500224 00000100:00100000:1.0:1789601482.156063:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858500224 00000100:00100000:1.0:1789601482.156130:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:1.0:1789601482.156141:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91eddcdac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:10474:x1876532858500224:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1789601482.156405:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91eddcdac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:10474:x1876532858500224:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 266us (503us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789601482.156413:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:0.0:1789601482.182942:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601482.183054:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858500480 00000100:00100000:3.0:1789601482.183065:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858500480 00000100:00100000:3.0:1789601482.183173:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 88 00000100:00100000:3.0:1789601482.183185:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:9994:x1876532858500480:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789601482.183212:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601482.183235:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac56f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061138 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.183340:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac576 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.183357:0:8248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac55a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061131 expref: 23 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.183367:0:8248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac576 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.183403:0:8248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac55a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061131 expref: 23 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.183437:0:8248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac55a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061131 expref: 23 pid: 8248 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601482.183452:0:8248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf9da8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880544000:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789601482.183556:0:8248:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7e36d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789601482.187247:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601482.187356:0:8248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf9da8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880544000:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601482.187382:0:8248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac576 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601482.187459:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858500608 00000100:00100000:2.0:1789601482.187467:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858500608 00010000:00010000:2.0:1789601482.187518:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac55a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061131 expref: 24 pid: 8248 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601482.187559:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:2.0:1789601482.187569:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+24:2357:x1876532858500608:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601482.187585:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601482.187592:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac55a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061131 expref: 24 pid: 8248 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.187604:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac55a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061131 expref: 24 pid: 8248 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.188359:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac55a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061131 expref: 24 pid: 8248 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.188381:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:2.0:1789601482.188385:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac576 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.188394:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac576 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.188402:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac576 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.188457:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601482.188518:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+23:2357:x1876532858500608:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 949us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601482.188527:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00010000:00010000:3.0:1789601482.188732:0:8248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac576 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.188769:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac576 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601482.188789:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789601482.188973:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac56f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061138 expref: 24 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.188993:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac576 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061138 expref: 23 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.189000:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:3.0:1789601482.189003:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789601482.189006:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc600, rc 0) 00000100:00100000:3.0:1789601482.189033:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+23:9994:x1876532858500480:12345-192.168.201.30@tcp:101:bash.0 Request processed in 5851us (6102us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789601482.189050:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 88 00000100:00100000:0.0:1789601482.192832:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601482.193701:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858500864 00000100:00100000:1.0:1789601482.193714:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858500864 00000100:00100000:1.0:1789601482.193815:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 89 00000100:00100000:1.0:1789601482.193826:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+23:9994:x1876532858500864:12345-192.168.201.30@tcp:36:bash.0 00010000:00010000:1.0:1789601482.194225:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac584 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.194246:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.194260:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789601482.194314:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1789601482.194337:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a54e0114 reply state 00000000eaa88329 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601482.194347:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789601482.194398:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1789601482.194580:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+27:9994:x1876532858500864:12345-192.168.201.30@tcp:36:bash.0 Request processed in 755us (1757us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1789601482.194589:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 89 00000020:00080000:1.0:1789601482.194594:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1789601482.196789:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac584 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.196805:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac584 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.196813:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac584 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.196820:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601482.196824:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac584 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.196832:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac584 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.196881:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:3.0:1789601482.196884:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601482.196889:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac584 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.196895:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac584 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601482.197361:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601482.197574:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858500992 00000100:00100000:2.0:1789601482.197585:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858500992 00000100:00100000:2.0:1789601482.197655:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 90 00000100:00100000:2.0:1789601482.197666:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+26:9994:x1876532858500992:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1789601482.197696:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601482.197714:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac58b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506113f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.197774:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac58b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506113f expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.197789:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac58b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506113f expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.197809:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:2.0:1789601482.197812:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789601482.197815:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8c000, rc 0) 00000100:00100000:2.0:1789601482.197919:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+27:9994:x1876532858500992:12345-192.168.201.30@tcp:101:bash.0 Request processed in 255us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601482.197926:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 90 00000100:00100000:0.0:1789601482.200929:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601482.201061:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858501120 00000100:00100000:3.0:1789601482.201073:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858501120 00000100:00100000:3.0:1789601482.201136:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:3.0:1789601482.201147:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:9994:x1876532858501120:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789601482.201168:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601482.201207:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d52cbd70/0xf3d6e402158ac592 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061146 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789601482.201236:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aab26c7, atime: 0x6aab26c5, ctime: 0x6aab26c7, blocks: 0xb 00010000:00010000:3.0:1789601482.201263:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=352s v=(0 0) 00010000:00010000:3.0:1789601482.201268:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601482.201276:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cbd70/0xf3d6e402158ac592 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061146 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.201296:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d52cbd70/0xf3d6e402158ac592 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061146 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.201308:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc400, rc 0) 00000100:00100000:3.0:1789601482.201427:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:9994:x1876532858501120:12345-192.168.201.30@tcp:101:bash.0 Request processed in 281us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601482.201434:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:1.0:1789601482.205124:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601482.209236:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858501248 00000100:00100000:0.0:1789601482.209271:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858501248 00002000:00010000:0.0:1789601482.209336:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789601482.209341:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91edfff66680 with x1876532858501248 ext(0->18446744073709551615) 00002000:00010000:0.0:1789601482.209354:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91edfff66680. 00000100:00100000:0.0:1789601482.209389:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:0.0:1789601482.209400:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2356:x1876532858501248:12345-192.168.201.30@tcp:10:bash.0 00002000:00010000:0.0:1789601482.209724:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789601482.209728:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789601479 -> 1789601483 00002000:00010000:0.0:1789601482.209730:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789601477 -> 1789601477 00002000:00010000:0.0:1789601482.209733:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789601479 -> 1789601483 00002000:00010000:0.0:1789601482.209735:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789601482.209824:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2356:x1876532858501248:12345-192.168.201.30@tcp:10:bash.0 Request processed in 424us (4710us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789601482.209832:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00002000:00010000:0.0:1789601482.209857:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789601482.209860:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91edfff66680 with x1876532858501248 ext(0->18446744073709551615) 00002000:00010000:0.0:1789601482.209866:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91edfff66680. 00000100:00100000:1.0:1789601482.299005:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601482.299081:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858501376 00000100:00100000:3.0:1789601482.299093:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858501376 00000100:00100000:3.0:1789601482.299155:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 91 00000100:00100000:3.0:1789601482.299166:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+27:10488:x1876532858501376:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:3.0:1789601482.299243:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac599 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.299261:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac599 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.299275:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac599 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.299305:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.299313:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.299320:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.299984:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.299995:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300004:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601482.300049:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300061:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac599 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300067:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac599 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300074:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac599 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300080:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadce00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601482.300084:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac599 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300099:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac599 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300112:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:3.0:1789601482.300115:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601482.300119:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac599 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300126:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac599 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300139:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300145:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300151:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300156:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffaddc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601482.300158:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300163:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300170:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91edd8ce5200) 00010000:00010000:3.0:1789601482.300172:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601482.300174:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300191:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300209:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300215:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300220:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300225:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601482.300229:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300235:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300242:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:3.0:1789601482.300243:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601482.300246:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.300250:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601482.300381:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+27:10488:x1876532858501376:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 1214us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601482.300503:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 91 00000100:00100000:2.0:1789601482.366393:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601482.366513:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858501632 00000100:00100000:3.0:1789601482.366540:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858501632 00000100:00100000:3.0:1789601482.366620:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:3.0:1789601482.366633:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+27:10491:x1876532858501632:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601482.366658:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601482.366684:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506114d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.366758:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.366773:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.366785:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.366800:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.366807:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.366813:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.367131:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac5c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.367141:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac5c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.367161:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac5c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601482.367172:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789601482.367277:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.367285:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.367292:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.367298:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffaddc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601482.367303:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.367311:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.367324:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:3.0:1789601482.367327:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601482.367332:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.367338:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.367352:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.367359:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.367371:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.367377:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadce00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601482.367380:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.367387:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.367395:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91edd8ce5200) 00010000:00010000:3.0:1789601482.367397:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601482.367400:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.367406:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.367456:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506114d expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.367471:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac5c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506114d expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.367478:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:3.0:1789601482.367480:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789601482.367483:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadd600, rc 0) 00000100:00100000:3.0:1789601482.367567:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+29:10491:x1876532858501632:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 936us (1184us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1789601482.367584:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:1.0:1789601482.373493:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601482.373718:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858501760 00000100:00100000:3.0:1789601482.373730:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858501760 00000100:00100000:3.0:1789601482.373792:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93 00000100:00100000:3.0:1789601482.373803:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+29:10491:x1876532858501760:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:3.0:1789601482.373918:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.373936:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac576 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061138 expref: 29 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.373946:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5d1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.373983:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac576 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061138 expref: 29 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.373997:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac576 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061138 expref: 29 pid: 8248 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601482.374013:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf9da8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1876532880544128:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789601482.374104:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7e36d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789601482.383616:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf9da8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1876532880544128:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601482.383651:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601482.392933:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601482.393094:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858502016 00000100:00100000:0.0:1789601482.393105:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858502016 00000100:00100000:0.0:1789601482.393202:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:0.0:1789601482.393213:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+30:5597:x1876532858502016:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789601482.393534:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+31:5597:x1876532858502016:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 322us (610us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789601482.393543:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:1.0:1789601482.400354:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601482.400475:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858502144 00000100:00100000:2.0:1789601482.400535:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858502144 00010000:00010000:2.0:1789601482.400578:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac576 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061138 expref: 31 pid: 8248 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601482.400630:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:2.0:1789601482.400640:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+31:2356:x1876532858502144:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601482.400657:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601482.400665:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac576 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061138 expref: 31 pid: 8248 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.400678:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac576 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061138 expref: 31 pid: 8248 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.400699:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac576 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061138 expref: 31 pid: 8248 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.400715:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:2.0:1789601482.400720:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.400729:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.400738:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5d1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.400767:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601482.400824:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+30:2356:x1876532858502144:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 186us (481us total) trans 0 rc 0/0 00010000:00010000:3.0:1789601482.401146:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.401161:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.401194:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.401201:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.401208:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.401214:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadca00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601482.401218:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.401225:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.401235:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:3.0:1789601482.401238:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601482.401241:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.401246:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601482.401300:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+30:10491:x1876532858501760:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 27499us (27825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601482.401309:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93 00000100:00100000:2.0:1789601482.401377:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:1.0:1789601482.410257:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601482.410361:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858502400 00000100:00100000:2.0:1789601482.410372:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858502400 00000100:00100000:2.0:1789601482.410508:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:2.0:1789601482.410530:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+29:10491:x1876532858502400:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789601482.410799:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+30:10491:x1876532858502400:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 280us (550us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789601482.410807:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:0.0:1789601482.536951:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601482.537049:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858502656 00000100:00100000:3.0:1789601482.537062:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858502656 00000100:00100000:3.0:1789601482.537139:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94 00000100:00100000:3.0:1789601482.537149:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+30:10502:x1876532858502656:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:3.0:1789601482.537174:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601482.537207:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061154 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.537498:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.537515:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.537528:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.537543:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.537549:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.537554:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.537974:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.537984:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.538003:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601482.538015:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1789601482.538126:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.538134:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.539849:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.539870:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601482.539876:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.539887:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.539905:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:3.0:1789601482.539908:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601482.539914:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.539921:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac5df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.539941:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.539948:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.539972:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.539977:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadce00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601482.539980:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.539987:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.539995:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91edd8ce5200) 00010000:00010000:3.0:1789601482.539997:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601482.540000:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.540006:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac5e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.540072:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061154 expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.540683:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061154 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.540692:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:3.0:1789601482.540694:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601482.540697:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffaddc00, rc 0) 00000100:00100000:3.0:1789601482.541602:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+32:10502:x1876532858502656:12345-192.168.201.30@tcp:101:cat.0 Request processed in 4450us (4658us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1789601482.541625:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94 00000100:00100000:1.0:1789601482.553776:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601482.554203:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858502912 00000100:00100000:0.0:1789601482.554228:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858502912 00000100:00100000:0.0:1789601482.554325:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:0.0:1789601482.554339:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+32:10502:x1876532858502912:12345-192.168.201.30@tcp:35:cat.0 00000100:00100000:0.0:1789601482.554564:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+33:10502:x1876532858502912:12345-192.168.201.30@tcp:35:cat.0 Request processed in 232us (798us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789601482.554569:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:1.0:1789601482.597446:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601482.597537:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858503168 00000100:00100000:3.0:1789601482.597547:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858503168 00000100:00100000:3.0:1789601482.597595:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 95 00000100:00100000:3.0:1789601482.597602:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+33:10503:x1876532858503168:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:3.0:1789601482.597681:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789601482.597708:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac5ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061154 expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.597804:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac5c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506114d expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.597820:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac58b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506113f expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.597832:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:3.0:1789601482.597882:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601482.597900:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.597911:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.597920:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.597933:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac602 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.597952:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac602 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.597960:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac602 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.598171:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac609 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.598180:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac609 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.598187:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac609 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789601482.602926:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1789601482.602945:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352641107409ns, next at 353641102921ns, rc = 0 00010000:00010000:3.0:1789601482.603049:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac610 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.603067:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac610 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.603079:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac610 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.603090:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac610 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.603096:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac610 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.603120:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac610 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.603151:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789601482.603177:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac609 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.603184:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac609 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.603199:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac609 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.603206:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601482.603211:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac609 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.603218:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac609 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.603230:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8ce5500) 00010000:00010000:3.0:1789601482.603232:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789601482.603237:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac609 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.603243:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac609 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.603263:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.603269:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5fb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.603282:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.603287:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadca00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601482.603289:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.603295:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.603303:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:3.0:1789601482.603305:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601482.603308:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.603315:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac5fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601482.603326:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc8a11aa reply state 000000009aeb0d8a transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac602 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601482.603335:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789601482.603439:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+32:10503:x1876532858503168:12345-192.168.201.30@tcp:36:rm.0 Request processed in 5831us (5996us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789601482.603448:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 95 00010000:00010000:1.0:1789601482.603998:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601482.604008:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac610 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.604017:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc600 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601482.604020:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac610 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.604027:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac610 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.604038:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91edd8ce5500) 00010000:00010000:1.0:1789601482.604041:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789601482.604044:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac610 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.604050:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac610 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.604069:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601482.604071:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601482.604073:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601482.606708:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac602 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.606727:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac602 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.606735:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac602 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.606741:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadce00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601482.606745:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac602 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.606754:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac602 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.606770:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91edd8ce5200) 00010000:00010000:0.0:1789601482.606774:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601482.606780:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac602 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.606785:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac602 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601482.666742:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601482.666872:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858503424 00000100:00100000:0.0:1789601482.666896:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858503424 00000100:00100000:0.0:1789601482.666974:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 96 00000100:00100000:0.0:1789601482.666986:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+31:10509:x1876532858503424:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1789601482.667011:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601482.667251:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158ac617 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506115b expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.667360:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac61e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.667374:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac61e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.667383:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac61e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.667394:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac625 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.667399:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac625 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.667402:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac625 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789601482.668152:0:8248:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1789601482.668335:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ac62c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.668348:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ac62c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.668370:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ac62c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.668405:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac61e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.668413:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac61e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.668420:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac61e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.668426:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601482.668430:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac61e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.668438:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac61e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.668450:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:0.0:1789601482.668453:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601482.668459:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac61e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.668465:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac61e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789601482.668494:0:8248:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009789cbb7 reply state 0000000028329a8b transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac625 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601482.668504:0:8248:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789601482.668540:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158ac617 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506115b expref: 34 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.668555:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ac62c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506115b expref: 33 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.668562:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd0646900) 00010000:00010000:0.0:1789601482.668565:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789601482.668567:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924400, rc 0) 00000100:00100000:0.0:1789601482.668719:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+34:10509:x1876532858503424:12345-192.168.201.30@tcp:101:bash.0 Request processed in 1735us (1985us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789601482.668728:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 96 00010000:00010000:3.0:1789601482.679320:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac625 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.679342:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac625 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.679364:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac625 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.679369:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601482.679373:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac625 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.679379:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac625 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.679392:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91edd0646200) 00010000:00010000:3.0:1789601482.679394:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601482.679399:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac625 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.679404:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac625 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601482.679458:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601482.680255:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858503552 00000100:00100000:3.0:1789601482.680269:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858503552 00000100:00100000:3.0:1789601482.680338:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:3.0:1789601482.680349:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2356:x1876532858503552:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789601482.680368:0:11670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601482.680386:0:11670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac63a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061162 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789601482.680412:0:11670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601482.680431:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=352s v=(0 0) 00010000:00010000:3.0:1789601482.680445:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601482.680454:0:11670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac63a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061162 expref: 6 pid: 11670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.680476:0:11670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac63a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061162 expref: 6 pid: 11670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.680499:0:11670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadca00, rc 0) 00000100:00100000:3.0:1789601482.680570:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858503552:12345-192.168.201.30@tcp:101:bash.0 Request processed in 223us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601482.680577:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:2.0:1789601482.683552:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601482.683647:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858503680 00000100:00100000:3.0:1789601482.683659:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858503680 00000100:00100000:3.0:1789601482.683714:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:3.0:1789601482.683724:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:10509:x1876532858503680:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789601482.683742:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601482.683760:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000279d7ac4/0xf3d6e402158ac641 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061169 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.683794:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac63a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061162 expref: 7 pid: 11670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.683803:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601482.683808:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601482.683813:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000279d7ac4/0xf3d6e402158ac641 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061169 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.684334:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac63a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061162 expref: 7 pid: 11670 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.684351:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac63a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061162 expref: 7 pid: 11670 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601482.684368:0:6679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1876532880544256:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789601482.684632:0:6679:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf8b83f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789601482.687532:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601482.687625:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858503808 00000100:00100000:1.0:1789601482.687646:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858503808 00010000:00010000:1.0:1789601482.687685:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac63a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061162 expref: 8 pid: 11670 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601482.687731:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:1.0:1789601482.687741:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede51e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2357:x1876532858503808:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601482.687755:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601482.687776:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac63a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061162 expref: 8 pid: 11670 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.687790:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac63a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061162 expref: 8 pid: 11670 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.687816:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601482.687820:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601482.687831:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000279d7ac4/0xf3d6e402158ac641 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061169 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.687873:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000279d7ac4/0xf3d6e402158ac641 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061169 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.687913:0:8437:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000279d7ac4/0xf3d6e402158ac641 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061169 expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601482.687928:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8437:1876532880544384:192.168.201.30@tcp:105: 00010000:00010000:0.0:1789601482.689976:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac63a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061162 expref: 8 pid: 11670 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601482.690000:0:6679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6679:1876532880544256:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789601482.690187:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000279d7ac4/0xf3d6e402158ac641 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061169 expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.690201:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc800, rc 0) 00000100:00100000:0.0:1789601482.690324:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:10509:x1876532858503680:12345-192.168.201.30@tcp:101:bash.0 Request processed in 6600us (6781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601482.690334:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:1.0:1789601482.690636:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601482.696372:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8437:1876532880544384:192.168.201.30@tcp:105: 00010000:00010000:1.0:1789601482.696417:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601482.696514:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede51e3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858503808:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 8772us (8990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601482.696527:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:2.0:1789601482.701328:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601482.701523:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858504064 00000100:00100000:3.0:1789601482.701538:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858504064 00000100:00100000:3.0:1789601482.701745:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:3.0:1789601482.701759:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+33:10509:x1876532858504064:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:3.0:1789601482.702326:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+34:10509:x1876532858504064:12345-192.168.201.30@tcp:35:bash.0 Request processed in 567us (1009us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1789601482.702337:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00010000:00010000:1.0:1789601482.761118:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601482.877277:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601482.877436:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858504192 00000100:00100000:1.0:1789601482.877450:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858504192 00000100:00100000:1.0:1789601482.877537:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:1.0:1789601482.877549:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9da8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+34:10525:x1876532858504192:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1789601482.877588:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601482.877620:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac648 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061170 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.877702:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ac64f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.877716:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ac64f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.877727:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ac64f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601482.877764:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789601482.877768:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789601482.877786:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ac64f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.877811:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac648 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061170 expref: 36 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.877914:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ac64f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061170 expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.877925:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:1.0:1789601482.877929:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789601482.877935:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c5c00, rc 0) 00000100:00100000:1.0:1789601482.878018:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9da8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+35:10525:x1876532858504192:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 471us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601482.878025:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:2.0:1789601482.887250:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601482.887439:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858504448 00000100:00100000:3.0:1789601482.887454:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858504448 00000100:00100000:3.0:1789601482.887540:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 98 00000100:00100000:3.0:1789601482.887552:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+35:10525:x1876532858504448:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601482.887584:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601482.887616:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac656 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061177 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.887749:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac65d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.887767:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac65d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.887780:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac65d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601482.887795:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789601482.887990:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac656 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061177 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.888034:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac65d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061177 expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.888042:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd0646900) 00010000:00010000:3.0:1789601482.888046:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601482.888050:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadd600, rc 0) 00000100:00100000:3.0:1789601482.888138:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+37:10525:x1876532858504448:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 587us (902us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1789601482.888147:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 98 00000100:00100000:2.0:1789601482.893927:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601482.896774:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601482.896910:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858504832 00000100:00100000:3.0:1789601482.896925:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858504832 00000100:00100000:3.0:1789601482.896998:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00100000:3.0:1789601482.897011:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+37:10525:x1876532858504832:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601482.897044:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601482.897071:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac66b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506117e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.897209:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac672 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.897228:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac672 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.897241:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac672 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601482.897256:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789601482.897440:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac66b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506117e expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.897464:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac672 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506117e expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.897474:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd0646900) 00010000:00010000:3.0:1789601482.897488:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789601482.897492:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadca00, rc 0) 00000100:00100000:3.0:1789601482.897571:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+39:10525:x1876532858504832:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 562us (810us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1789601482.897579:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00100000:1.0:1789601482.903143:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858504576 00000100:00100000:1.0:1789601482.903164:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858504576 00000100:00100000:1.0:1789601482.903273:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:1.0:1789601482.903286:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+39:2359:x1876532858504576:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601482.903307:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601482.903340:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac65d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061177 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.903368:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd0646900) 00010000:00010000:1.0:1789601482.903375:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601482.903460:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+38:2359:x1876532858504576:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 176us (9627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601482.903468:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:3.0:1789601482.904194:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601482.904793:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858504960 00000100:00100000:1.0:1789601482.904805:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858504960 00000100:00100000:1.0:1789601482.904890:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:1.0:1789601482.904901:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858504960:12345-192.168.201.30@tcp:1:lfs.0 00010000:00010000:1.0:1789601482.904973:0:11670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e16ae05/0xf3d6e402158ac680 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.904999:0:11670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000279d7ac4/0xf3d6e402158ac641 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061169 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.905009:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601482.905014:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601482.905018:0:11670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e16ae05/0xf3d6e402158ac680 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.905058:0:11670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000279d7ac4/0xf3d6e402158ac641 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061169 expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601482.905074:0:11670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000279d7ac4/0xf3d6e402158ac641 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061169 expref: 6 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601482.905091:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11670:1876532880544512:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789601482.905201:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc604240 going to sleep for 11 seconds 00000100:00100000:3.0:1789601482.908408:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11670:1876532880544512:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601482.908466:0:11670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e16ae05/0xf3d6e402158ac680 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601482.909785:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601482.910222:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858505088 00000100:00100000:2.0:1789601482.910234:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858505088 00002000:00100000:2.0:1789601482.910311:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff91edf8b18380 x1876532858505088/t0(0) o4->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:78/0 lens 504/0 e 0 to 0 dl 1789601493 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789601482.910341:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91edf8b18380 with x1876532858505088 ext(0->8) 00010000:00010000:2.0:1789601482.910352:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000279d7ac4/0xf3d6e402158ac641 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061169 expref: 7 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.910371:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000279d7ac4/0xf3d6e402158ac641 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061169 expref: 7 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789601482.910379:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91edf8b18380 00000100:00100000:2.0:1789601482.910422:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:2.0:1789601482.910433:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2357:x1876532858505088:12345-192.168.201.30@tcp:4:lfs.0 00000100:00100000:2.0:1789601482.912370:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:2357:x1876532858505088:12345-192.168.201.30@tcp:4:lfs.0 Request processed in 1923us (2576us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789601482.912388:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00002000:00100000:2.0:1789601482.912412:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff91edf8b18380 x1876532858505088/t4294967302(0) o4->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:78/0 lens 504/448 e 0 to 0 dl 1789601493 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789601482.912423:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91edf8b18380 with x1876532858505088 ext(0->8) 00010000:00010000:2.0:1789601482.912434:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000279d7ac4/0xf3d6e402158ac641 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061169 expref: 9 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.912455:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000279d7ac4/0xf3d6e402158ac641 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061169 expref: 9 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789601482.912463:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91edf8b18380 00000100:00100000:2.0:1789601482.916534:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601482.916662:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858505216 00000100:00100000:3.0:1789601482.916675:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858505216 00010000:00010000:3.0:1789601482.916724:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000279d7ac4/0xf3d6e402158ac641 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061169 expref: 9 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601482.916777:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:3.0:1789601482.916788:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:2358:x1876532858505216:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601482.916809:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789601482.916870:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789601482.916873:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789601483 00002000:00010000:3.0:1789601482.916876:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789601484 00002000:00010000:3.0:1789601482.916879:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789601483 00010000:00010000:3.0:1789601482.916886:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000279d7ac4/0xf3d6e402158ac641 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061169 expref: 9 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.916903:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000279d7ac4/0xf3d6e402158ac641 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061169 expref: 9 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.916943:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000279d7ac4/0xf3d6e402158ac641 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061169 expref: 9 pid: 6679 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.916965:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789601482.916969:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789601482.916976:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e16ae05/0xf3d6e402158ac680 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.916988:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e16ae05/0xf3d6e402158ac680 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.917025:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601482.917809:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2358:x1876532858505216:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1015us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601482.917822:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00010000:00010000:3.0:1789601482.917889:0:11670:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e16ae05/0xf3d6e402158ac680 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.917925:0:11670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e16ae05/0xf3d6e402158ac680 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.917958:0:11670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e16ae05/0xf3d6e402158ac680 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.917968:0:11670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e16ae05/0xf3d6e402158ac680 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.917977:0:11670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e16ae05/0xf3d6e402158ac680 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.917985:0:11670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5e00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601482.917991:0:11670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e16ae05/0xf3d6e402158ac680 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.918001:0:11670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e16ae05/0xf3d6e402158ac680 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.918018:0:11670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e16ae05/0xf3d6e402158ac680 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.918026:0:11670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e16ae05/0xf3d6e402158ac680 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601482.919741:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2356:x1876532858504960:12345-192.168.201.30@tcp:1:lfs.0 Request processed in 14827us (15537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601482.919759:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:1.0:1789601482.922367:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601482.922729:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858505472 00000100:00100000:2.0:1789601482.922743:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858505472 00000100:00100000:2.0:1789601482.922819:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:2.0:1789601482.922832:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91eddcdaf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+38:10525:x1876532858505472:12345-192.168.201.30@tcp:35:lfs.0 00000004:00010000:2.0:1789601482.922964:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac672 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506117e expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789601482.923366:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1789601482.923903:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1789601482.924288:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1789601482.924726:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac687 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.924750:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ac62c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506115b expref: 42 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.924761:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac687 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.924816:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ac62c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506115b expref: 42 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.924879:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ac62c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506115b expref: 42 pid: 8248 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601482.924899:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8dea680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1876532880544640:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789601482.925022:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf8b83000 going to sleep for 11 seconds 00000100:00100000:2.0:1789601482.928892:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8dea680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1876532880544640:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789601482.928961:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac687 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601482.929417:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601482.929585:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858505600 00000100:00100000:2.0:1789601482.929595:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858505600 00010000:00010000:2.0:1789601482.929745:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ac62c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506115b expref: 43 pid: 8248 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601482.929787:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:2.0:1789601482.929797:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+43:2357:x1876532858505600:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601482.929818:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601482.929826:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ac62c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506115b expref: 43 pid: 8248 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.929856:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ac62c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506115b expref: 43 pid: 8248 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.929883:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ac62c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506115b expref: 43 pid: 8248 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.929905:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd0646900) 00010000:00010000:2.0:1789601482.929912:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac687 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.929924:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac687 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.929934:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac687 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601482.929979:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601482.930048:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+42:2357:x1876532858505600:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 252us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601482.930057:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00010000:00010000:0.0:1789601482.930124:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac687 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601482.930133:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac687 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789601482.930333:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1789601482.931140:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1789601482.931299:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edefec2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1876532880544768:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789601482.932054:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601482.932107:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03daa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601482.932331:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880544768 00000100:00100000:2.0:1789601482.932342:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880544768 00000100:00100000:2.0:1789601482.932411:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789601482.932422:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1876532880544768:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789601482.932562:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1876532880544768:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 142us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601482.932570:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789601482.932732:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edefec2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1876532880544768:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789601482.933970:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1789601482.934104:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b19f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1876532880544896:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789601482.934186:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601482.934229:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7e36540 going to sleep for 11 seconds 00000100:00100000:0.0:1789601482.934877:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880544896 00000100:00100000:0.0:1789601482.934888:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880544896 00000100:00100000:0.0:1789601482.934949:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789601482.934960:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1876532880544896:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789601482.935242:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1876532880544896:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 283us (1055us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789601482.935251:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789601482.935775:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b19f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1876532880544896:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789601482.935909:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1789601482.935972:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac687 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.935987:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac687 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.935997:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac687 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.936004:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601482.936009:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac687 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.936019:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac687 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.936039:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd0646900) 00010000:00010000:3.0:1789601482.936059:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789601482.936066:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac687 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.936074:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac687 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789601482.936372:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789601482.937060:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1789601482.937079:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352975240913ns, next at 353975237066ns, rc = 0 00000001:00080000:2.0:1789601482.937089:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1789601482.937144:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd0646900) 00010000:00010000:2.0:1789601482.937149:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789601482.937161:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac672 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506117e expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601482.937303:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91eddcdaf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+45:10525:x1876532858505472:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 14473us (14954us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1789601482.937326:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 26 00000020:00080000:2.0:1789601482.937333:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789601482.945670:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601482.945770:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858505728 00000100:00100000:3.0:1789601482.945785:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858505728 00000100:00100000:3.0:1789601482.945898:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 100 00000100:00100000:3.0:1789601482.945911:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+45:10525:x1876532858505728:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601482.945945:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601482.945977:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac68e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061185 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.946062:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac68e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061185 expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.946081:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac68e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061185 expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601482.946105:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:3.0:1789601482.946110:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789601482.946114:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc800, rc 0) 00000100:00100000:3.0:1789601482.946191:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+46:10525:x1876532858505728:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 283us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601482.946199:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 100 00000100:00100000:2.0:1789601482.953678:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601482.953877:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858505984 00000100:00100000:3.0:1789601482.953907:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858505984 00000100:00100000:3.0:1789601482.953974:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:3.0:1789601482.953986:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+46:10525:x1876532858505984:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1789601482.954287:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+47:10525:x1876532858505984:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 302us (624us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1789601482.954293:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:1.0:1789601483.043377:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601483.044190:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858506112 00000100:00100000:3.0:1789601483.044206:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858506112 00000100:00100000:2.0:1789601483.044470:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00100000:2.0:1789601483.044494:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+47:10535:x1876532858506112:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:2.0:1789601483.044638:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac695 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.044659:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.044677:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.044694:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac69c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.044702:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac69c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.044709:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac69c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.044832:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac6a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.044864:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045248:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601483.045308:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045325:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac695 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045346:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac695 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045354:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac695 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045361:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8cc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601483.045366:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac695 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045376:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac695 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045403:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:2.0:1789601483.045406:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601483.045414:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac695 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045422:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac695 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045441:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac69c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045447:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac69c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045454:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac69c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045460:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8da00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601483.045470:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac69c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045486:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac69c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045494:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91edd8a67600) 00010000:00010000:2.0:1789601483.045497:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601483.045499:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac69c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045505:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8da00/0xf3d6e402158ac69c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045524:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac6a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045530:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac6a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045535:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac6a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045540:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601483.045689:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac6a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045695:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac6a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045703:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:2.0:1789601483.045705:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601483.045715:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac6a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.045721:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac6a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601483.045971:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+47:10535:x1876532858506112:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 1475us (2604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601483.045983:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00080000:1.0:1789601483.047535:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601483.098505:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601483.098627:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858506368 00000100:00100000:3.0:1789601483.098644:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858506368 00000100:00100000:3.0:1789601483.098722:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 102 00000100:00100000:3.0:1789601483.098735:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+47:10538:x1876532858506368:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601483.098767:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601483.098799:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac6aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506118c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.098955:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac6b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.098977:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac6b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.098993:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac6b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.099012:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.099021:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.099051:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.099338:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac6bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.099349:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac6bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.099357:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac6bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601483.099371:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789601483.099538:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac6b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.099547:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac6b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.099555:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac6b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.099561:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffaddc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601483.099567:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac6b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.099576:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac6b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.099806:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:3.0:1789601483.099811:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601483.099830:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac6b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.099881:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac6b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.099904:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.099911:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.099917:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.099922:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadce00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601483.099925:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.099931:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.099940:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91edd8ce5a00) 00010000:00010000:3.0:1789601483.099942:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601483.099946:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.099952:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.100016:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac6aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506118c expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.100046:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac6bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506118c expref: 49 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.100054:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:3.0:1789601483.100057:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601483.100059:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc600, rc 0) 00000100:00100000:3.0:1789601483.100573:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+49:10538:x1876532858506368:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1836us (2106us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789601483.100584:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 102 00000100:00100000:2.0:1789601483.104370:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601483.105193:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858506496 00000100:00100000:3.0:1789601483.105213:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858506496 00000100:00100000:3.0:1789601483.105301:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:3.0:1789601483.105315:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+49:10538:x1876532858506496:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:3.0:1789601483.105422:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac6cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.105445:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac6cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.105458:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac6cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.105501:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac6cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.105508:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac6cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.105540:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac6cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.106061:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadca00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601483.106134:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac6cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.106145:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac6cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.106162:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:3.0:1789601483.106166:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601483.106172:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac6cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.106180:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac6cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601483.106559:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+49:10538:x1876532858506496:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 1234us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601483.106571:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:1.0:1789601483.111996:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601483.112183:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858506752 00000100:00100000:2.0:1789601483.112197:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858506752 00000100:00100000:2.0:1789601483.112311:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:2.0:1789601483.112326:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+49:10538:x1876532858506752:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789601483.112776:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+50:10538:x1876532858506752:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 453us (794us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1789601483.112785:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:0.0:1789601483.188634:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601483.188952:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858507008 00000100:00100000:3.0:1789601483.188974:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858507008 00000100:00100000:3.0:1789601483.189062:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 104 00000100:00100000:3.0:1789601483.189086:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+50:10547:x1876532858507008:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789601483.189123:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601483.189127:0:8248:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789601483.189166:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ac64f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061170 expref: 50 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.189195:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:3.0:1789601483.189202:0:8248:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601483.189243:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac6d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061193 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.189679:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac6db lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.189699:0:8248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac6bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506118c expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.189710:0:8248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac6db lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.189763:0:8248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac6bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506118c expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.189784:0:8248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac6bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506118c expref: 50 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601483.189802:0:8248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880545024:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789601483.190256:0:8248:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffc97180 going to sleep for 11 seconds 00000100:00100000:0.0:1789601483.201561:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601483.201696:0:8248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880545024:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601483.201732:0:8248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac6db lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601483.202060:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858507136 00000100:00100000:1.0:1789601483.202080:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858507136 00010000:00010000:1.0:1789601483.202132:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac6bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506118c expref: 51 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601483.202180:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:1.0:1789601483.202190:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+51:2356:x1876532858507136:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601483.202211:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601483.202220:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac6bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506118c expref: 51 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601483.202233:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac6bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506118c expref: 51 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601483.202264:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac6bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506118c expref: 51 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601483.202283:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:1.0:1789601483.202288:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac6db lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601483.202300:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac6db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601483.202311:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac6db lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601483.202400:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601483.202501:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+50:2356:x1876532858507136:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 311us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601483.202509:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00010000:00010000:0.0:1789601483.204444:0:8248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac6db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.204465:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac6db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601483.204503:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789601483.204977:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac6d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061193 expref: 51 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.205005:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac6db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061193 expref: 50 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.205033:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:0.0:1789601483.205036:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789601483.205040:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc200, rc 0) 00000100:00100000:0.0:1789601483.205250:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+50:10547:x1876532858507008:12345-192.168.201.30@tcp:101:bash.0 Request processed in 16164us (16632us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789601483.205261:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 104 00000100:00100000:0.0:1789601483.209960:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601483.210643:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858507392 00000100:00100000:3.0:1789601483.210657:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858507392 00000100:00100000:3.0:1789601483.210738:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 105 00000100:00100000:3.0:1789601483.210752:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+50:10547:x1876532858507392:12345-192.168.201.30@tcp:36:bash.0 00010000:00010000:3.0:1789601483.212033:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.212180:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.212198:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601483.212282:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1789601483.212379:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000077148e8f reply state 000000001d827555 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601483.212390:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789601483.212585:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+53:10547:x1876532858507392:12345-192.168.201.30@tcp:36:bash.0 Request processed in 1832us (2634us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789601483.212604:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 105 00000020:00080000:3.0:1789601483.212611:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789601483.214900:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.214925:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.214932:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.214937:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadce00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601483.214941:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.214948:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.214966:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:0.0:1789601483.214968:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601483.214972:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.214977:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac6e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601483.216378:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601483.216512:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858507520 00000100:00100000:2.0:1789601483.216527:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858507520 00000100:00100000:2.0:1789601483.216681:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 106 00000100:00100000:2.0:1789601483.216691:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+52:10547:x1876532858507520:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1789601483.216723:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601483.216746:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac6f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506119a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.216870:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac6f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.216898:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac6db lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061193 expref: 53 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.216923:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac6f7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.216963:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac6db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061193 expref: 53 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.216976:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac6db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061193 expref: 53 pid: 8248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601483.216989:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1876532880545152:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789601483.217094:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf8b83000 going to sleep for 11 seconds 00000100:00100000:1.0:1789601483.220491:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601483.220659:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858507648 00000100:00100000:3.0:1789601483.220674:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858507648 00010000:00010000:3.0:1789601483.220731:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac6db lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061193 expref: 54 pid: 8248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601483.220781:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:3.0:1789601483.220792:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+54:2356:x1876532858507648:12345-192.168.201.30@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789601483.220797:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1876532880545152:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601483.220809:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601483.220817:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac6db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061193 expref: 54 pid: 8248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.220829:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac6db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061193 expref: 54 pid: 8248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.220945:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac6f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.221035:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac6db lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061193 expref: 54 pid: 8248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.221051:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:3.0:1789601483.221055:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac6f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.221063:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.221072:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac6f7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.221398:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601483.221454:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.221464:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601483.221485:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+53:2356:x1876532858507648:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 694us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601483.221494:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000004:00200000:2.0:1789601483.221751:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789601483.221757:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789601483.221785:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac6f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.221824:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac6f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506119a expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.221882:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506119a expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.221891:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:2.0:1789601483.221894:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601483.221896:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8de00, rc 0) 00000100:00100000:2.0:1789601483.221927:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+52:10547:x1876532858507520:12345-192.168.201.30@tcp:101:bash.0 Request processed in 5237us (5560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601483.221935:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 106 00000100:00100000:3.0:1789601483.225518:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601483.225608:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858507904 00000100:00100000:2.0:1789601483.225621:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858507904 00000100:00100000:2.0:1789601483.225695:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:2.0:1789601483.225707:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+52:10547:x1876532858507904:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:2.0:1789601483.226058:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+53:10547:x1876532858507904:12345-192.168.201.30@tcp:35:bash.0 Request processed in 352us (552us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1789601483.226075:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:2.0:1789601483.257177:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601483.257344:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858508032 00000100:00100000:1.0:1789601483.257358:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858508032 00000100:00100000:1.0:1789601483.257734:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 107 00000100:00100000:1.0:1789601483.257749:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+53:10554:x1876532858508032:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1789601483.257783:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601483.257813:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac6fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50611a1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601483.257932:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158ac705 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601483.257953:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158ac705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601483.257969:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158ac705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601483.258014:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789601483.258018:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789601483.258042:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158ac705 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601483.258074:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac6fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611a1 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601483.258097:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158ac705 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611a1 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601483.258125:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:1.0:1789601483.258129:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789601483.258134:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c4a00, rc 0) 00000100:00100000:1.0:1789601483.258226:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+54:10554:x1876532858508032:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 480us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601483.258236:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 107 00000100:00100000:2.0:1789601483.261262:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601483.261370:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858508160 00000100:00100000:0.0:1789601483.261385:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858508160 00000100:00100000:0.0:1789601483.261760:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 108 00000100:00100000:0.0:1789601483.261773:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+54:10554:x1876532858508160:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789601483.261803:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601483.261874:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ac70c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50611a8 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.261970:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac713 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.261997:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac713 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262015:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac713 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262037:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac71a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262045:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac71a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262051:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac71a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262208:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158ac721 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262240:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158ac721 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262247:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158ac721 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601483.262301:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789601483.262307:0:8248:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789601483.262335:0:8248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158ac721 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262351:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158ac721 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262363:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac713 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262372:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac713 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262380:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac713 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262387:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601483.262416:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac713 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262426:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac713 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262446:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:0.0:1789601483.262449:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601483.262463:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac713 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262480:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac713 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262500:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac71a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262507:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac71a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262513:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac71a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262519:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601483.262521:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac71a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262527:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac71a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262536:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91edd0646300) 00010000:00010000:0.0:1789601483.262539:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601483.262553:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac71a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.262559:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ac71a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.263018:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ac70c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611a8 expref: 56 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.263055:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158ac721 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611a8 expref: 55 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.263063:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:0.0:1789601483.263066:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789601483.263069:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924000, rc 0) 00000100:00100000:0.0:1789601483.263179:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:10554:x1876532858508160:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1409us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601483.263188:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 108 00000100:00100000:2.0:1789601483.267588:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601483.267642:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601483.267654:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858508416 00000100:00100000:3.0:1789601483.267669:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858508416 00000100:00100000:3.0:1789601483.267750:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 109 00000100:00100000:3.0:1789601483.267763:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:10554:x1876532858508416:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601483.267789:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601483.267822:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac728 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50611af expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.267982:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.268011:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac6f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506119a expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.268018:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158ac721 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611a8 expref: 56 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.268024:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.268063:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158ac721 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611a8 expref: 56 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.268077:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158ac721 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611a8 expref: 56 pid: 8248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601483.268095:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edd8d91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1876532880545280:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601483.268203:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506119a expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.268212:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac6f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506119a expref: 56 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601483.268221:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00283800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1876532880545408:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789601483.268247:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffc97180 going to sleep for 11 seconds 00000100:00100000:1.0:1789601483.268417:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858508544 00000100:00100000:1.0:1789601483.268423:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858508544 00010000:00010000:1.0:1789601483.268449:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158ac721 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611a8 expref: 57 pid: 8248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601483.268484:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:1.0:1789601483.268491:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+57:2357:x1876532858508544:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601483.268501:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601483.268507:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158ac721 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611a8 expref: 57 pid: 8248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601483.268517:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158ac721 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611a8 expref: 57 pid: 8248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601483.268536:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:1.0:1789601483.268548:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601483.268553:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601483.268567:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601483.268601:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+57:2357:x1876532858508544:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 109us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601483.268609:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:2.0:1789601483.272139:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:3.0:1789601483.272298:0:5837:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.30@tcp) returned -22 from blocking AST (req@00000000f212e9a1 x1876532880545280) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158ac721 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611a8 expref: 56 pid: 8248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.272351:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158ac721 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611a8 expref: 56 pid: 8248 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601483.272375:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edd8d91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1876532880545280:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789601483.272407:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00283800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1876532880545408:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601483.272439:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:3.0:1789601483.272445:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.272455:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.272466:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601483.273204:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858508672 00000100:00100000:0.0:1789601483.273217:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858508672 00010000:00010000:0.0:1789601483.273272:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac6f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506119a expref: 56 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601483.273350:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:0.0:1789601483.273361:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede51e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+56:2356:x1876532858508672:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601483.273382:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601483.273402:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac6f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506119a expref: 56 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.273417:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac6f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506119a expref: 56 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.273447:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac6f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506119a expref: 56 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.273495:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:0.0:1789601483.273501:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.273510:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.273520:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601483.273798:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601483.273912:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede51e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:2356:x1876532858508672:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 551us (1787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601483.273921:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 55 00010000:00010000:2.0:1789601483.274825:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.274875:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601483.274922:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789601483.275138:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac728 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611af expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.275165:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611af expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.275176:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:2.0:1789601483.275179:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789601483.275184:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffaddc00, rc 0) 00000100:00100000:2.0:1789601483.275243:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:10554:x1876532858508416:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 7483us (7672us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789601483.275253:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 109 00000100:00100000:2.0:1789601483.278063:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601483.278188:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858508928 00000100:00100000:1.0:1789601483.278203:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858508928 00000100:00100000:1.0:1789601483.278283:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1789601483.278296:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:10554:x1876532858508928:12345-192.168.201.30@tcp:103:lfs.0 00010000:00010000:1.0:1789601483.278317:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601483.278354:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac68e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061185 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601483.278378:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:1.0:1789601483.278384:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601483.278461:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+54:10554:x1876532858508928:12345-192.168.201.30@tcp:103:lfs.0 Request processed in 168us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601483.278478:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1789601483.280563:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601483.280688:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858509056 00000100:00100000:2.0:1789601483.280700:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858509056 00000100:00100000:2.0:1789601483.280765:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 110 00000100:00100000:2.0:1789601483.280778:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+54:10554:x1876532858509056:12345-192.168.201.30@tcp:58:lfs.0 00010000:00010000:2.0:1789601483.280945:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac73d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.280968:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac73d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601483.280984:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac73d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789601483.281239:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789601483.281364:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+54:10554:x1876532858509056:12345-192.168.201.30@tcp:58:lfs.0 Request processed in 588us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601483.281373:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 110 00000100:00100000:2.0:1789601483.283928:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601483.284194:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858509184 00000100:00100000:3.0:1789601483.284209:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858509184 00000100:00100000:3.0:1789601483.284281:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00100000:3.0:1789601483.284294:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+54:10554:x1876532858509184:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601483.284324:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601483.284353:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac744 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50611b6 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.284436:0:8248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac73d lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.284480:0:8248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac744 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611b6 expref: 55 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.284505:0:8248:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac73d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.284520:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac744 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611b6 expref: 55 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.284539:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:3.0:1789601483.284543:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789601483.284547:0:8248:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac744 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611b6 expref: 55 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601483.284555:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadd600, rc 0) 00000100:00100000:3.0:1789601483.284647:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8313800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:10554:x1876532858509184:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 355us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601483.284654:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00100000:0.0:1789601483.721517:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880545536:0@lo:400:kworker.0 00000100:00100000:0.0:1789601483.721622:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601483.721695:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880546048:0@lo:400:kworker.0 00000100:00100000:0.0:1789601483.721728:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601483.721760:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789601483.721766:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880545920:0@lo:400:kworker.0 00000100:00100000:0.0:1789601483.721809:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601483.721865:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880545792:0@lo:400:kworker.0 00000100:00100000:0.0:1789601483.721891:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601483.721909:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789601483.721914:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880545664:0@lo:400:kworker.0 00000100:00100000:0.0:1789601483.721934:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601483.721959:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880546176:0@lo:400:kworker.0 00000100:00100000:0.0:1789601483.721980:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601483.722014:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880545920 00000100:00100000:0.0:1789601483.722024:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880545920 00000100:00100000:0.0:1789601483.722085:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880546176 00000100:00100000:0.0:1789601483.722088:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880546176 00000100:00100000:0.0:1789601483.722115:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789601483.722124:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1876532880545920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601483.722186:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7eddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1876532880545920:12345-0@lo:400:kworker.0 Request processed in 63us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601483.722262:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789601483.722284:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789601483.722291:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1876532880546176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601483.722327:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1876532880546176:12345-0@lo:400:kworker.0 Request processed in 37us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601483.722332:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789601483.722378:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880546176:0@lo:400:kworker.0 00000100:00100000:0.0:1789601483.722411:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880545920:0@lo:400:kworker.0 00000100:00100000:2.0:1789601483.722627:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880545536 00000100:00100000:2.0:1789601483.722632:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880545536 00000100:00100000:2.0:1789601483.722674:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789601483.722681:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880545536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601483.722733:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880545536:12345-0@lo:400:kworker.0 Request processed in 53us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601483.722740:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1789601483.722825:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880545536:0@lo:400:kworker.0 00000100:00100000:2.0:1789601483.722876:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880546048 00000100:00100000:2.0:1789601483.722880:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880546048 00000100:00100000:2.0:1789601483.722909:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880545792 00000100:00100000:2.0:1789601483.722911:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880545792 00000100:00100000:2.0:1789601483.722926:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880545664 00000100:00100000:2.0:1789601483.722928:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880545664 00000100:00100000:2.0:1789601483.722942:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789601483.722948:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880546048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601483.722986:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880546048:12345-0@lo:400:kworker.0 Request processed in 38us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601483.722992:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789601483.723014:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880546048:0@lo:400:kworker.0 00000100:00100000:2.0:1789601483.723033:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789601483.723039:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880545792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601483.723075:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880545792:12345-0@lo:400:kworker.0 Request processed in 36us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601483.723091:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789601483.723106:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789601483.723112:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880545664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601483.723140:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880545664:12345-0@lo:400:kworker.0 Request processed in 29us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601483.723147:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:1.0:1789601483.723446:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789601483.723453:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601483.723455:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601483.723571:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880545664:0@lo:400:kworker.0 00000100:00100000:0.0:1789601483.723586:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880545792:0@lo:400:kworker.0 00010000:00010000:1.0:1789601483.785143:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789601484.169278:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789601484.169302:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789601484.169386:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789601484.169399:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789601484.169589:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8a0ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1876532880546304:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789601484.169737:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03da900 going to sleep for 11 seconds 00000100:00100000:0.0:1789601484.180465:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8a0ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1876532880546304:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789601484.181209:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601484.181798:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858509312 00000100:00100000:2.0:1789601484.181811:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858509312 00000100:00100000:2.0:1789601484.181926:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 112 00000100:00100000:2.0:1789601484.181940:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:10555:x1876532858509312:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789601484.181994:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789601484.182131:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:10555:x1876532858509312:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 195us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601484.182140:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 112 00000100:00100000:2.0:1789601484.195136:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601484.195254:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858509440 00000100:00100000:3.0:1789601484.195269:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858509440 00000100:00100000:3.0:1789601484.195359:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 113 00000100:00100000:3.0:1789601484.195372:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:10555:x1876532858509440:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789601484.195494:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac74b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.195517:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac74b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.195958:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac74b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.200410:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac752 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.200438:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac752 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.200779:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac752 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.200819:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac759 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.200830:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac759 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.200856:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac759 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601484.200911:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789601484.200917:0:8248:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789601484.200932:0:8248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac759 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.200947:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac74b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.200955:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac74b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.200984:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac74b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.200990:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601484.200995:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac74b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.201003:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac74b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.201017:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91edd35e8700) 00010000:00010000:3.0:1789601484.201020:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601484.201025:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac74b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.201032:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac74b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.201049:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac752 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.201056:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac752 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.201062:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac752 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.201067:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601484.201070:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac752 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.201086:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac752 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.201095:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff91edd8ce5a00) 00010000:00010000:3.0:1789601484.201097:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601484.201100:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac752 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.201106:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac752 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.201122:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac759 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.201129:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac759 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.201134:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac759 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.201140:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadce00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601484.201143:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac759 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.201149:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac759 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.201155:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:3.0:1789601484.201157:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601484.201160:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac759 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.201175:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac759 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601484.201574:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:10555:x1876532858509440:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 Request processed in 6200us (6452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601484.201654:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 113 00000100:00100000:1.0:1789601484.204155:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601484.204270:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858509696 00000100:00100000:2.0:1789601484.204284:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858509696 00000100:00100000:2.0:1789601484.204410:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 114 00000100:00100000:2.0:1789601484.204423:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:10555:x1876532858509696:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601484.204467:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601484.204500:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac760 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50611bd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.204677:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac767 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.204720:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.204736:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601484.204751:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789601484.204950:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac767 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.204958:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac767 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.204966:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac767 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.204974:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601484.204979:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac767 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.204998:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac767 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.205013:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:2.0:1789601484.205016:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789601484.205021:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac767 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.205027:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac767 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.205083:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac760 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611bd expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.205102:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91edd35e8700) 00010000:00010000:2.0:1789601484.205104:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789601484.205108:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac760 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611bd expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.205121:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8dc00, rc 0) 00000100:00100000:2.0:1789601484.205210:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+56:10555:x1876532858509696:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 790us (1071us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1789601484.205219:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 114 00000100:00100000:3.0:1789601484.212979:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601484.213185:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858509824 00000100:00100000:2.0:1789601484.213201:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858509824 00000100:00100000:2.0:1789601484.213273:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00100000:2.0:1789601484.213285:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+56:10555:x1876532858509824:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789601484.213370:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789601484.213535:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+56:10555:x1876532858509824:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 252us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601484.213552:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 115 00000100:00100000:3.0:1789601484.217653:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601484.218024:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858510080 00000100:00100000:2.0:1789601484.218038:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858510080 00000100:00100000:2.0:1789601484.218119:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 116 00000100:00100000:2.0:1789601484.218131:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+56:10555:x1876532858510080:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601484.218161:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601484.218165:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789601484.218201:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158ac705 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611a1 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.218251:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:2.0:1789601484.218258:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601484.218276:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac775 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50611c4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789601484.219250:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789601484.219971:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac77c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.220125:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac77c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.220142:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac77c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.220236:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac775 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611c4 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.220262:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac77c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611c4 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.220272:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91edd8a67600) 00010000:00010000:2.0:1789601484.220275:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601484.220280:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8c600, rc 0) 00000100:00100000:2.0:1789601484.220390:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+57:10555:x1876532858510080:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 2259us (2751us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1789601484.220401:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 116 00000100:00100000:0.0:1789601484.227785:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601484.229809:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858510336 00000100:00100000:2.0:1789601484.229833:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858510336 00000100:00100000:2.0:1789601484.230183:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 117 00000100:00100000:2.0:1789601484.230196:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+57:10555:x1876532858510336:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789601484.230280:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601484.230320:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac77c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611c4 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.230352:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91edd8a67600) 00010000:00010000:2.0:1789601484.230366:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601484.230399:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac78a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.230416:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac78a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.230428:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac78a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.232776:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac791 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xae6fbd11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.232805:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xae6fbd11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.232820:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xae6fbd11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.233199:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac78a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.233233:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac78a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.233240:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac78a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.233245:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8dc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601484.233250:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac78a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.233257:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac78a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.233270:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:2.0:1789601484.233273:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601484.233279:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac78a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.233285:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac78a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.233297:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac791 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xae6fbd11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.233303:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac791 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xae6fbd11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.233309:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac791 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xae6fbd11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.233315:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601484.233324:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac791 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xae6fbd11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.233330:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac791 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xae6fbd11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.233339:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xae6fbd11 (ffff91edd8a67a00) 00010000:00010000:2.0:1789601484.233341:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601484.233345:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac791 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xae6fbd11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.233352:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac791 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xae6fbd11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601484.233480:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+56:10555:x1876532858510336:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 3281us (5702us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789601484.233491:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 117 00000004:00080000:1.0:1789601484.238651:0:8064:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354276809500ns, next at 355276806298ns, rc = 0 00000100:00100000:2.0:1789601484.238764:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880546432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601484.238960:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601484.239324:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880546432 00000100:00100000:1.0:1789601484.239349:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880546432 00000100:00100000:1.0:1789601484.239439:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789601484.239462:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1876532880546432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601484.239511:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601484.239604:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1876532880546432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601484.239611:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789601484.239772:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880546432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601484.239975:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601484.240317:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858510464 00000100:00100000:3.0:1789601484.240326:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858510464 00000100:00100000:3.0:1789601484.240383:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 118 00000100:00100000:3.0:1789601484.240393:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc7049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+56:10555:x1876532858510464:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789601484.240414:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601484.240449:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac798 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50611cb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.240513:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac79f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.240530:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac79f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.240554:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac79f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.240688:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac798 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611cb expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.240719:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac79f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611cb expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.240728:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:3.0:1789601484.240732:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789601484.240736:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc200, rc 0) 00000100:00100000:3.0:1789601484.240809:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc7049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+57:10555:x1876532858510464:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 418us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601484.240817:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 118 00000100:00100000:0.0:1789601484.247365:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601484.247524:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858510720 00000100:00100000:3.0:1789601484.247552:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858510720 00000100:00100000:3.0:1789601484.247645:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 119 00000100:00100000:3.0:1789601484.247660:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc704b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+57:10555:x1876532858510720:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789601484.247826:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac7a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.248120:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.248138:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789601484.252555:0:8248:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:0.0:1789601484.253984:0:8248:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096cbef6a reply state 0000000012a66dd9 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601484.254006:0:8248:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789601484.254184:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc704b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+59:10555:x1876532858510720:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 6521us (6830us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1789601484.254194:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 119 00010000:00010000:3.0:1789601484.256493:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.256524:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac7a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.256572:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac7a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.256588:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadce00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601484.256595:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac7a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.256604:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac7a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.256631:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:3.0:1789601484.256635:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789601484.256641:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac7a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.256650:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac7a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601484.258436:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601484.258559:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858510848 00000100:00100000:2.0:1789601484.258580:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858510848 00000100:00100000:2.0:1789601484.258682:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00100000:2.0:1789601484.258693:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+58:10555:x1876532858510848:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601484.258724:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601484.258752:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac7ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50611d2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.259165:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac7ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611d2 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.259201:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac7ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611d2 expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.259225:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:2.0:1789601484.259229:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789601484.259235:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8c000, rc 0) 00000100:00100000:2.0:1789601484.259388:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+59:10555:x1876532858510848:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 695us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601484.259397:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 120 00000100:00100000:0.0:1789601484.265411:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601484.265522:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858510976 00000100:00100000:2.0:1789601484.265543:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858510976 00000100:00100000:2.0:1789601484.265697:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:2.0:1789601484.265708:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2357:x1876532858510976:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789601484.266095:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:2357:x1876532858510976:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 387us (701us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789601484.266104:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00080000:1.0:1789601484.266524:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601484.276204:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601484.276429:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858511232 00000100:00100000:2.0:1789601484.276441:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858511232 00000100:00100000:2.0:1789601484.276580:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:2.0:1789601484.276592:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+59:10555:x1876532858511232:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789601484.276944:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+60:10555:x1876532858511232:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 354us (750us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789601484.276953:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:3.0:1789601484.281370:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601484.282150:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858511488 00000100:00100000:2.0:1789601484.282175:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858511488 00000100:00100000:2.0:1789601484.282227:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 121 00000100:00100000:2.0:1789601484.282237:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+60:10555:x1876532858511488:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789601484.282347:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+60:10555:x1876532858511488:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 112us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601484.282354:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 121 00000100:00100000:1.0:1789601484.290361:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601484.294613:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858511616 00000100:00100000:0.0:1789601484.294629:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858511616 00000100:00100000:0.0:1789601484.294699:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 122 00000100:00100000:0.0:1789601484.294709:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+60:10555:x1876532858511616:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601484.294730:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601484.294751:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50611d9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.294817:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158ac7bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.295033:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158ac7bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.295066:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158ac7bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601484.295108:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789601484.295129:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158ac7bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.295161:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611d9 expref: 62 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.295184:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158ac7bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611d9 expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.295192:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:0.0:1789601484.295196:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789601484.295200:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924600, rc 0) 00000100:00100000:0.0:1789601484.295350:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+61:10555:x1876532858511616:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 642us (5000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601484.295358:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 122 00000100:00100000:3.0:1789601484.298270:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601484.298472:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858511744 00000100:00100000:0.0:1789601484.298483:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858511744 00000100:00100000:0.0:1789601484.298584:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:0.0:1789601484.298594:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:2358:x1876532858511744:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601484.298614:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601484.298635:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50611e0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789601484.298679:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab26cd, blocks: 0x1 00010000:00010000:0.0:1789601484.298704:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=354s v=(0 0) 00010000:00010000:0.0:1789601484.298709:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601484.298719:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e0 expref: 10 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.298740:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e0 expref: 10 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.298754:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924400, rc 0) 00000100:00100000:0.0:1789601484.298818:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00282a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+10:2358:x1876532858511744:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 225us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601484.298825:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:3.0:1789601484.302432:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601484.302494:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858512000 00000100:00100000:2.0:1789601484.302507:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858512000 00000100:00100000:2.0:1789601484.302570:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 123 00000100:00100000:2.0:1789601484.302592:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+61:10555:x1876532858512000:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789601484.302710:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+61:10555:x1876532858512000:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 119us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601484.302717:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 123 00000100:00100000:1.0:1789601484.304707:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601484.304800:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858512128 00000100:00100000:2.0:1789601484.304808:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858512128 00000100:00100000:2.0:1789601484.304878:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:2.0:1789601484.304888:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+10:10555:x1876532858512128:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601484.304903:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601484.304921:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002801fd94/0xf3d6e402158ac7c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50611e7 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.304949:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e0 expref: 11 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.304955:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601484.304959:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601484.304975:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002801fd94/0xf3d6e402158ac7c9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e7 expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.305010:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e0 expref: 11 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.305025:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e0 expref: 11 pid: 6677 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601484.305040:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876532880546560:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789601484.305126:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf8b83000 going to sleep for 11 seconds 00000100:00100000:3.0:1789601484.307647:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601484.307791:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa8f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876532880546560:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789601484.307994:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858512256 00000100:00100000:0.0:1789601484.308003:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858512256 00010000:00010000:0.0:1789601484.308042:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e0 expref: 12 pid: 6677 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.308103:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002801fd94/0xf3d6e402158ac7c9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e7 expref: 12 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.308123:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8dc00, rc 0) 00000100:00100000:2.0:1789601484.308188:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+12:10555:x1876532858512128:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 3301us (3488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601484.308196:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:0.0:1789601484.308255:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:0.0:1789601484.308263:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00280a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+11:2357:x1876532858512256:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601484.308275:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601484.308293:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e0 expref: 11 pid: 6677 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.308317:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e0 expref: 11 pid: 6677 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.308336:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e0 expref: 11 pid: 6677 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.308348:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601484.308351:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601484.308356:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002801fd94/0xf3d6e402158ac7c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e7 expref: 10 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.308363:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002801fd94/0xf3d6e402158ac7c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e7 expref: 10 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.308392:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002801fd94/0xf3d6e402158ac7c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e7 expref: 10 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601484.308407:0:5822:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8bbc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5822:1876532880546688:192.168.201.30@tcp:105: 00000100:00100000:0.0:1789601484.308467:0:5822:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03da900 going to sleep for 11 seconds 00000100:00100000:0.0:1789601484.310883:0:5822:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8bbc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5822:1876532880546688:192.168.201.30@tcp:105: 00010000:00010000:0.0:1789601484.310910:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601484.310964:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00280a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+10:2357:x1876532858512256:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 2700us (3325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601484.310975:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:3.0:1789601484.314299:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601484.314377:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858512384 00000100:00100000:0.0:1789601484.314485:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858512384 00002000:00100000:0.0:1789601484.314601:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff91ee00283b80 x1876532858512384/t0(0) o4->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:80/0 lens 504/0 e 0 to 0 dl 1789601495 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789601484.314629:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91ee00283b80 with x1876532858512384 ext(0->12) 00002000:00010000:0.0:1789601484.314635:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91ee00283b80 00000100:00100000:0.0:1789601484.315343:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:0.0:1789601484.315360:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+10:2359:x1876532858512384:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789601484.315534:0:6682:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789601484.315546:0:6682:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789601484.316390:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00283b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+12:2359:x1876532858512384:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 Request processed in 1030us (2095us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789601484.316401:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00002000:00100000:0.0:1789601484.316411:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff91ee00283b80 x1876532858512384/t4294967308(0) o4->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:80/0 lens 504/448 e 0 to 0 dl 1789601495 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789601484.316420:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91ee00283b80 with x1876532858512384 ext(0->12) 00002000:00010000:0.0:1789601484.316426:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91ee00283b80 00000100:00100000:3.0:1789601484.318772:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601484.319023:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858512512 00000100:00100000:2.0:1789601484.319033:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858512512 00000100:00100000:2.0:1789601484.319088:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:2.0:1789601484.319098:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+61:10555:x1876532858512512:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789601484.386081:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000020:00080000:3.0:1789601484.386139:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91edffc97540 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1789601484.386146:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91edf7f2c500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91edffc97900 00000020:00080000:3.0:1789601484.386150:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91edf7f2cc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91ee008e9c00 00000004:00080000:3.0:1789601484.386196:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:3.0:1789601484.386234:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000100:00100000:1.0:1789601484.386265:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+38:10555:x1876532858512512:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 Request processed in 67155us (67486us total) trans 0 rc 0/0 00000020:00080000:3.0:1789601484.386266:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:1.0:1789601484.386286:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 124 00000004:00080000:3.0:1789601484.386322:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1789601484.386344:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91edf7e36b40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1789601484.386348:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91edffe66500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91edf7e36900 00000020:00080000:3.0:1789601484.386352:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91edffe66e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91edf892d400 00000004:00080000:3.0:1789601484.386367:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:1.0:1789601484.386623:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880546816:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789601484.386675:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601484.386739:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601484.386747:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880546944:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789601484.386772:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601484.386821:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880546816 00000100:00100000:0.0:1789601484.386833:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880546816 00000100:00100000:0.0:1789601484.386914:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880546944 00000100:00100000:0.0:1789601484.386918:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880546944 00000100:00100000:0.0:1789601484.386946:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789601484.386958:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1876532880546816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789601484.386992:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1789601484.387030:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601484.387047:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1789601484.387065:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d52cbd70/0xf3d6e402158ac592 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061146 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601484.387070:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1876532880546944:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789601484.387087:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789601484.387093:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00002000:00080000:1.0:1789601484.387099:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1789601484.387099:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7d0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789601484.387144:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aab26cb, atime: 0x6aab26cc, ctime: 0x6aab26cb, blocks: 0x1 00010000:00010000:0.0:1789601484.387151:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d52cbd70/0xf3d6e402158ac592 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061146 expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.387157:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a07dd63c/0xf3d6e402158ac7d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.387179:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d52cbd70/0xf3d6e402158ac592 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061146 expref: 11 pid: 6679 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.387182:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=354s v=(0 0) 00000100:00100000:0.0:1789601484.387200:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8bbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1876532880547072:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601484.387206:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601484.387216:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a07dd63c/0xf3d6e402158ac7d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.387237:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a07dd63c/0xf3d6e402158ac7d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.387248:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a07dd63c/0xf3d6e402158ac7d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.387255:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a07dd63c/0xf3d6e402158ac7d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.387288:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789601484.387307:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03dab40 going to sleep for 11 seconds 00000020:00080000:2.0:1789601484.387490:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1789601484.387679:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:0.0:1789601484.387992:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601484.388000:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a07dd63c/0xf3d6e402158ac7d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.388009:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5c00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601484.388014:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a07dd63c/0xf3d6e402158ac7d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.388022:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a07dd63c/0xf3d6e402158ac7d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.388054:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a07dd63c/0xf3d6e402158ac7d7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.388061:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a07dd63c/0xf3d6e402158ac7d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.388081:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601484.388083:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601484.388085:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601484.389286:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3319:x1876532880546944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2224us (2509us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789601484.389296:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1789601484.389871:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91ee00280e00/2, rc 0, transno 4294967304 00000100:00100000:3.0:1789601484.389886:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880546944:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789601484.392709:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601484.392821:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858512640 00000100:00100000:0.0:1789601484.392900:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858512640 00000100:00100000:0.0:1789601484.392971:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:0.0:1789601484.392982:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+12:2356:x1876532858512640:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789601484.401550:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601484.401582:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8bbc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1876532880547072:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789601484.401596:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858512768 00000100:00100000:1.0:1789601484.401608:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858512768 00010000:00010000:3.0:1789601484.401631:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.401660:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d52cbd70/0xf3d6e402158ac592 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061146 expref: 13 pid: 6679 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601484.401711:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:1.0:1789601484.401720:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:2356:x1876532858512768:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601484.401734:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601484.401740:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d52cbd70/0xf3d6e402158ac592 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061146 expref: 13 pid: 6679 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.401763:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d52cbd70/0xf3d6e402158ac592 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061146 expref: 13 pid: 6679 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.401788:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d52cbd70/0xf3d6e402158ac592 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061146 expref: 13 pid: 6679 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.401806:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601484.401811:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601484.401817:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.401828:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7d0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.401909:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601484.401964:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+12:2356:x1876532858512768:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 245us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601484.401972:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00010000:00010000:1.0:1789601484.402098:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.402108:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.402119:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.402133:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.402155:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789601484.402229:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601484.402239:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.402250:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924400 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601484.402257:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.402269:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.402310:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7d0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.402319:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ac7d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601484.402349:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601484.402352:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601484.402354:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601484.402777:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3319:x1876532880546816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15819us (16099us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789601484.402787:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:3.0:1789601484.403138:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91ee002e9f80/2, rc 0, transno 4294967309 00000100:00100000:3.0:1789601484.403168:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880546816:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1789601484.448104:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1789601484.448231:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1789601484.448430:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2356:x1876532858512640:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 Request processed in 55444us (55731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601484.448441:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:1.0:1789601484.453790:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601484.453960:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858513024 00000100:00100000:0.0:1789601484.453970:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858513024 00000100:00100000:0.0:1789601484.454047:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 125 00000100:00100000:0.0:1789601484.454055:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+15:10555:x1876532858513024:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789601484.454099:0:8248:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601484.454121:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158ac7bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611d9 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.454136:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:0.0:1789601484.454151:0:8248:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789601484.454179:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.454190:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.454198:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789601484.454399:0:8248:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003024513d reply state 000000006d6d0d2a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601484.454409:0:8248:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789601484.454526:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+16:10555:x1876532858513024:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 470us (746us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789601484.454533:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 125 00010000:00010000:0.0:1789601484.456892:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.456910:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.456918:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.456924:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601484.456929:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.456935:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.456972:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:0.0:1789601484.456975:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601484.456980:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7de lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.456986:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601484.457616:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601484.457927:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858513152 00000100:00100000:0.0:1789601484.457940:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858513152 00000100:00100000:0.0:1789601484.457994:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:0.0:1789601484.458004:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2359:x1876532858513152:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789601484.458220:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789601484.458225:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789601484 00002000:00010000:0.0:1789601484.458227:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789601484 00002000:00010000:0.0:1789601484.458229:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789601485 -> 1789601484 00002000:00010000:0.0:1789601484.458231:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789601484.458310:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2359:x1876532858513152:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 306us (702us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789601484.458317:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:3.0:1789601484.465769:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601484.466002:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858513408 00000100:00100000:0.0:1789601484.466014:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858513408 00000100:00100000:0.0:1789601484.466074:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 126 00000100:00100000:0.0:1789601484.466084:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+15:10555:x1876532858513408:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789601484.466155:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.466190:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac79f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611cb expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.466198:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7e5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.466235:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac79f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611cb expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.466250:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac79f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611cb expref: 15 pid: 5837 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601484.466264:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8bbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1876532880547200:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789601484.466364:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8a1b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601484.469207:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8bbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1876532880547200:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789601484.469727:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601484.470213:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601484.470300:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858513536 00000100:00100000:1.0:1789601484.470309:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858513536 00010000:00010000:1.0:1789601484.470348:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac79f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611cb expref: 16 pid: 5837 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601484.470393:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:1.0:1789601484.470404:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+16:2357:x1876532858513536:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601484.470419:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601484.470426:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac79f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611cb expref: 16 pid: 5837 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.470438:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac79f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611cb expref: 16 pid: 5837 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.470470:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac79f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611cb expref: 16 pid: 5837 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.470511:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:1.0:1789601484.470517:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.470685:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.470693:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7e5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.470725:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601484.470826:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+15:2357:x1876532858513536:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 423us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601484.470834:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 58 00010000:00010000:0.0:1789601484.471074:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.471082:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.471113:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.471120:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.471138:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.471145:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601484.471149:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.471157:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.471165:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:0.0:1789601484.471168:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789601484.471172:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.471178:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158ac7e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601484.471222:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:10555:x1876532858513408:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 Request processed in 5140us (5464us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789601484.471232:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 126 00000100:00100000:2.0:1789601484.473953:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601484.474104:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858513664 00000100:00100000:1.0:1789601484.474117:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858513664 00000100:00100000:1.0:1789601484.474167:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:1.0:1789601484.474176:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2358:x1876532858513664:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789601484.474223:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ae1c9681/0xf3d6e402158ac7ec lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.474244:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002801fd94/0xf3d6e402158ac7c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e7 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.474253:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601484.474257:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789601484.474262:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae1c9681/0xf3d6e402158ac7ec lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.474319:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002801fd94/0xf3d6e402158ac7c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e7 expref: 7 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.474334:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002801fd94/0xf3d6e402158ac7c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e7 expref: 7 pid: 6676 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601484.474349:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1876532880547328:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789601484.474436:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc6046c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601484.478030:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601484.478234:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858513792 00000100:00100000:2.0:1789601484.478244:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858513792 00010000:00010000:2.0:1789601484.478284:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002801fd94/0xf3d6e402158ac7c9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e7 expref: 8 pid: 6676 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601484.478325:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:2.0:1789601484.478334:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2356:x1876532858513792:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601484.478349:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601484.478372:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002801fd94/0xf3d6e402158ac7c9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e7 expref: 8 pid: 6676 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.478387:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002801fd94/0xf3d6e402158ac7c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e7 expref: 8 pid: 6676 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.478412:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789601484.478416:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789601484.478422:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae1c9681/0xf3d6e402158ac7ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.478432:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae1c9681/0xf3d6e402158ac7ec lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.478462:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601484.478546:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2356:x1876532858513792:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 212us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601484.478553:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00010000:00010000:1.0:1789601484.479461:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002801fd94/0xf3d6e402158ac7c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611e7 expref: 7 pid: 6676 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601484.479480:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1876532880547328:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601484.479505:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ae1c9681/0xf3d6e402158ac7ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.479526:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ae1c9681/0xf3d6e402158ac7ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.479535:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae1c9681/0xf3d6e402158ac7ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.479566:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ae1c9681/0xf3d6e402158ac7ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.479601:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae1c9681/0xf3d6e402158ac7ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.479611:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae1c9681/0xf3d6e402158ac7ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.479620:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5800 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601484.479625:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae1c9681/0xf3d6e402158ac7ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.479635:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae1c9681/0xf3d6e402158ac7ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.479650:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae1c9681/0xf3d6e402158ac7ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.479658:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae1c9681/0xf3d6e402158ac7ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601484.479724:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2358:x1876532858513664:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 Request processed in 5548us (5782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601484.479733:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:3.0:1789601484.482560:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601484.482698:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858514048 00000100:00100000:2.0:1789601484.482709:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858514048 00000100:00100000:2.0:1789601484.482773:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 127 00000100:00100000:2.0:1789601484.482785:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:10555:x1876532858514048:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789601484.483057:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac7f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.483077:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac7f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.483088:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac7f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.483317:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac7fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.483329:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac7ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611d2 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.483337:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac7fa lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.483374:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac7ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611d2 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.483390:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac7ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611d2 expref: 15 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601484.483431:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1876532880547456:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789601484.483531:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd012ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601484.486386:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1876532880547456:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601484.486456:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac7fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601484.487367:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601484.487694:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858514176 00000100:00100000:0.0:1789601484.487705:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858514176 00010000:00010000:0.0:1789601484.487746:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac7ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611d2 expref: 16 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601484.487786:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:0.0:1789601484.487797:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+16:2357:x1876532858514176:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601484.487814:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601484.487831:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac7ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611d2 expref: 16 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.487946:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac7ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611d2 expref: 16 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.487969:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac7ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611d2 expref: 16 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.487987:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:0.0:1789601484.487992:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac7fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.488001:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac7fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.488008:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac7fa lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.488030:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601484.488088:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+15:2357:x1876532858514176:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 293us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601484.488095:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00010000:00010000:2.0:1789601484.488731:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac7fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.488742:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac7fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789601484.490031:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1789601484.490188:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1789601484.490227:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1789601484.490319:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1876532880547584:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789601484.490393:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601484.490433:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd012ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789601484.490534:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880547584 00000100:00100000:0.0:1789601484.490544:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880547584 00000100:00100000:0.0:1789601484.490609:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789601484.490620:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1876532880547584:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789601484.490701:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1876532880547584:12345-0@lo:1000:mdt00_002.0 Request processed in 83us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601484.490725:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789601484.490959:0:5839:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1789601484.490965:0:5839:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:1.0:1789601484.490988:0:5839:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff91ee002e9f80 x1876532880546816/t4294967309(4294967309) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789601500 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601484.491000:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1876532880547584:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789601484.491551:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1789601484.491618:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1876532880547712:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789601484.491663:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601484.491689:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8d4b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601484.491787:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880547712 00000100:00100000:0.0:1789601484.491793:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880547712 00000100:00100000:0.0:1789601484.491821:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789601484.491828:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1876532880547712:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789601484.492157:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5839:x1876532880547712:12345-0@lo:1000:mdt00_002.0 Request processed in 329us (491us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789601484.492164:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789601484.492377:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1876532880547712:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789601484.492692:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac7fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.492703:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac7fa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.492711:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac7fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.492716:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c400 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601484.492720:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac7fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.492727:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac7fa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.492744:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:1.0:1789601484.492757:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789601484.492763:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac7fa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.492770:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac7fa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.492804:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac73d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.492812:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac73d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.492817:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac73d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.492822:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601484.492825:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac73d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.492831:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac73d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.493238:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:1.0:1789601484.493240:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789601484.493248:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac744 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611b6 expref: 18 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.493262:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac744 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611b6 expref: 18 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.493272:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac744 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611b6 expref: 18 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601484.493326:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac744 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611b6 expref: 18 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601484.493341:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1876532880547840:192.168.201.30@tcp:105: 00000100:00100000:1.0:1789601484.493468:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc5386900 going to sleep for 11 seconds 00000100:00100000:1.0:1789601484.497526:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601484.498231:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1876532880547840:192.168.201.30@tcp:105: 00010000:00010000:2.0:1789601484.498268:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac73d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.498281:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ac73d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.498321:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac801 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.498334:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac801 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.498345:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac801 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.498367:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac801 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.498373:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac801 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.498379:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac801 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.498384:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8ce00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601484.498389:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac801 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.498396:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac801 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.498409:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:2.0:1789601484.498411:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601484.498415:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac801 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.498420:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac801 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.498429:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac7f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.498433:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac7f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.498438:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac7f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.498460:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601484.498464:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac7f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.498470:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac7f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.498478:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:2.0:1789601484.498481:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789601484.498483:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac7f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.498489:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac7f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601484.499038:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:10555:x1876532858514048:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 16253us (16484us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1789601484.499049:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 127 00000020:00080000:2.0:1789601484.499055:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789601484.500146:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858514304 00000100:00100000:0.0:1789601484.500159:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858514304 00000100:00100000:0.0:1789601484.500216:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:0.0:1789601484.500225:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:10554:x1876532858514304:12345-192.168.201.30@tcp:49:lfs.0 00000100:00100000:0.0:1789601484.500342:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:10554:x1876532858514304:12345-192.168.201.30@tcp:49:lfs.0 Request processed in 119us (2827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601484.500349:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:3.0:1789601484.502816:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601484.503381:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858514560 00000100:00100000:0.0:1789601484.503400:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858514560 00000100:00100000:0.0:1789601484.503511:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:0.0:1789601484.503531:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91eddcdadc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:10555:x1876532858514560:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789601484.504464:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789601484.504579:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1789601484.504632:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac808 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.504649:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac808 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.504673:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac808 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.504683:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac808 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.504690:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac808 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.504696:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac808 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.504726:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789601484.504832:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91eddcdadc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:10555:x1876532858514560:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 1301us (2024us total) trans 4294967408 rc 0/0 00010000:00010000:2.0:1789601484.504998:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601484.505005:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac808 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.505011:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925800 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601484.505014:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac808 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.505022:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac808 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.505044:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91edd0646800) 00010000:00010000:2.0:1789601484.505047:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789601484.505052:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac808 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.505057:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158ac808 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.505075:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601484.505077:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601484.505079:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789601484.505715:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601484.505722:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601484.506564:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000100:00100000:0.0:1789601484.506730:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 32 00000020:00080000:0.0:1789601484.506740:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1789601484.506833:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789601484.510211:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601484.510305:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858514816 00000100:00100000:1.0:1789601484.510314:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858514816 00000100:00100000:1.0:1789601484.510370:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 128 00000100:00100000:1.0:1789601484.510380:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:10554:x1876532858514816:12345-192.168.201.30@tcp:58:lfs.0 00000040:00080000:1.0:1789601484.510816:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789601484.510995:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:10554:x1876532858514816:12345-192.168.201.30@tcp:58:lfs.0 Request processed in 616us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601484.511004:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 128 00000100:00100000:1.0:1789601484.545460:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601484.546296:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858514944 00000100:00100000:0.0:1789601484.546309:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858514944 00000100:00100000:0.0:1789601484.546698:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 129 00000100:00100000:0.0:1789601484.546711:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:10557:x1876532858514944:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789601484.546739:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601484.546762:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ac80f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50611ee expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.546828:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac816 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.546870:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac816 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.546901:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac816 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.546921:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ac81d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.546928:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ac81d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.546936:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ac81d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.547204:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac824 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.547215:0:8248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611af expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.547223:0:8248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac824 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.547258:0:8248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611af expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.547274:0:8248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611af expref: 21 pid: 5837 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601484.547290:0:8248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8bbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880547968:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789601484.547728:0:8248:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8a1b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601484.551934:0:8248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8bbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880547968:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789601484.551966:0:8248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac824 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601484.553583:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601484.553806:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858515200 00000100:00100000:3.0:1789601484.553817:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858515200 00000100:00100000:3.0:1789601484.553916:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:3.0:1789601484.553927:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:5597:x1876532858515200:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789601484.554361:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+23:5597:x1876532858515200:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 435us (793us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1789601484.554370:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:0.0:1789601484.559776:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601484.559979:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858515328 00000100:00100000:2.0:1789601484.559991:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858515328 00010000:00010000:2.0:1789601484.560041:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611af expref: 23 pid: 5837 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601484.560120:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:2.0:1789601484.560130:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede51e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+23:2357:x1876532858515328:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601484.560146:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601484.560154:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611af expref: 23 pid: 5837 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.560169:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611af expref: 23 pid: 5837 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.560191:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac72f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611af expref: 23 pid: 5837 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.560229:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:2.0:1789601484.560235:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac824 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.560244:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.560253:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac824 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601484.560285:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601484.560341:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede51e1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:2357:x1876532858515328:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 212us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601484.560348:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00010000:00010000:0.0:1789601484.560808:0:8248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.560819:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601484.560894:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789601484.560899:0:8248:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789601484.560919:0:8248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.560934:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.560945:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac816 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.560952:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac816 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.560958:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac816 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.560964:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601484.560967:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac816 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.560974:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac816 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.560995:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:0.0:1789601484.560997:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601484.561001:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac816 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.561007:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158ac816 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.561019:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ac81d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.561025:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ac81d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.561031:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ac81d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.561037:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601484.561040:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ac81d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.561046:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ac81d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.561053:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91edd0646400) 00010000:00010000:0.0:1789601484.561055:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601484.561058:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ac81d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.561064:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ac81d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.561123:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ac80f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611ee expref: 22 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.561138:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac824 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611ee expref: 21 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601484.561145:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:0.0:1789601484.561147:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789601484.561150:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924200, rc 0) 00000100:00100000:0.0:1789601484.561186:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:10557:x1876532858514944:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 14479us (15745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601484.561192:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 129 00010000:00010000:3.0:1789601484.809298:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789601485.338544:0:12087:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601485.338555:0:12087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601485.338667:0:12087:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789601485.338673:0:12087:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789601485.521783:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601485.521793:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601485.521903:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789601485.521910:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789601485.522040:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00420000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1876532880548096:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789601485.522994:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcc54f840 going to sleep for 11 seconds 00000100:00100000:1.0:1789601485.538083:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00420000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1876532880548096:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789601485.538559:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601485.538592:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858515456 00000100:00100000:1.0:1789601485.538601:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858515456 00000100:00100000:1.0:1789601485.538663:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 130 00000100:00100000:1.0:1789601485.538673:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:10570:x1876532858515456:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789601485.538705:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789601485.538807:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:10570:x1876532858515456:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 134us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601485.538815:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 130 00000100:00080000:1.0:1789601485.538854:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601485.546540:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601485.546581:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858515712 00000100:00100000:1.0:1789601485.546590:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858515712 00000100:00100000:1.0:1789601485.546640:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 131 00000100:00100000:1.0:1789601485.546650:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:10570:x1876532858515712:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601485.546670:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601485.546692:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5800/0xf3d6e402158ac82b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50611f5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601485.546797:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158ac832 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601485.546828:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158ac832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601485.546866:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158ac832 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601485.546880:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789601485.547016:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5800/0xf3d6e402158ac82b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611f5 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601485.547034:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158ac832 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611f5 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601485.547044:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:1.0:1789601485.547047:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601485.547051:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c4a00, rc 0) 00000100:00100000:1.0:1789601485.547124:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+23:10570:x1876532858515712:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 474us (593us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789601485.547131:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 131 00000100:00100000:1.0:1789601485.554148:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601485.554243:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601485.554276:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858516096 00000100:00100000:1.0:1789601485.554287:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858516096 00000100:00100000:1.0:1789601485.554341:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 132 00000100:00100000:1.0:1789601485.554351:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+23:10570:x1876532858516096:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789601485.554440:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac840 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601485.554474:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601485.554487:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601485.554901:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601485.554910:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac840 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601485.554916:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac840 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601485.554922:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601485.554926:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac840 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601485.554934:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac840 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601485.554945:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:1.0:1789601485.554948:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789601485.554952:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac840 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601485.554957:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac840 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601485.555110:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+24:10570:x1876532858516096:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 758us (864us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789601485.555127:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 132 00000040:00080000:1.0:1789601485.555950:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601485.555955:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1789601485.556323:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858515840 00000100:00100000:2.0:1789601485.556333:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858515840 00000100:00100000:2.0:1789601485.556389:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:2.0:1789601485.556399:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00423100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+24:2358:x1876532858515840:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601485.556412:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601485.556442:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158ac832 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611f5 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601485.556457:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:2.0:1789601485.556461:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601485.556500:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00423100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+23:2358:x1876532858515840:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 104us (2374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601485.556507:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000040:00080000:1.0:1789601485.558363:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789601485.558379:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789601485.560236:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601485.560793:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858516352 00000100:00100000:0.0:1789601485.560804:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858516352 00000100:00100000:0.0:1789601485.560874:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:0.0:1789601485.560881:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+23:10570:x1876532858516352:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789601485.561084:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+24:10570:x1876532858516352:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 202us (855us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789601485.561092:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 34 00010000:00010000:2.0:1789601485.845610:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601486.293653:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601486.293691:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601486.293713:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601486.293739:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601486.293765:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858516736 00000100:00100000:2.0:1789601486.293774:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858516736 00000100:00100000:2.0:1789601486.293826:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858516608 00000100:00100000:2.0:1789601486.293829:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858516608 00000100:00100000:2.0:1789601486.293871:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 83 00000100:00100000:2.0:1789601486.293881:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2359:x1876532858516736:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601486.293947:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2359:x1876532858516736:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 67us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601486.293953:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 83 00000100:00100000:2.0:1789601486.293976:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:2.0:1789601486.293982:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2359:x1876532858516608:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601486.294004:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2359:x1876532858516608:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601486.294010:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00080000:2.0:1789601486.294032:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789601486.294036:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601486.294228:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858516864 00000100:00100000:2.0:1789601486.294308:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858516864 00000100:00100000:2.0:1789601486.294346:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 153 00000100:00100000:2.0:1789601486.294354:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+5:2359:x1876532858516864:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601486.294391:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+5:2359:x1876532858516864:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601486.294413:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 153 00000100:00080000:2.0:1789601486.294465:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601486.294905:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858516480 00000100:00100000:3.0:1789601486.294912:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858516480 00000100:00100000:3.0:1789601486.295043:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 292 00000100:00100000:3.0:1789601486.295052:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2359:x1876532858516480:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601486.295088:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2359:x1876532858516480:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601486.295210:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 292 00000001:00080000:0.0:1789601486.338380:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1789601486.338483:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1789601486.338651:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1789601486.793796:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601486.793820:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880548224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601486.793928:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601486.794054:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880548224 00000100:00100000:1.0:1789601486.794062:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880548224 00000100:00100000:1.0:1789601486.794129:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789601486.794138:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc4762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880548224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601486.794169:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601486.794214:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc4762050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880548224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601486.794220:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1789601486.794471:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601486.794510:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1789601486.794515:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1789601486.794543:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91ee00280e00, transno 4294967304 00000100:00100000:0.0:1789601486.794569:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880548224:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789601486.857766:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789601487.438360:0:12139:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789601487.438371:0:12139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789601487.438447:0:12139:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789601487.438453:0:12139:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789601487.707230:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601487.707358:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858517120 00000100:00100000:1.0:1789601487.707368:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858517120 00000100:00100000:1.0:1789601487.707619:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 133 00000100:00100000:1.0:1789601487.707630:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+24:10592:x1876532858517120:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1789601487.707658:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601487.707680:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac847 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50611fc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601487.707797:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5800/0xf3d6e402158ac84e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601487.707812:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5800/0xf3d6e402158ac84e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601487.707880:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5800/0xf3d6e402158ac84e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601487.707892:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789601487.708035:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac847 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611fc expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601487.708055:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5800/0xf3d6e402158ac84e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611fc expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601487.708063:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:1.0:1789601487.708066:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789601487.708070:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c5800, rc 0) 00000100:00100000:1.0:1789601487.708131:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+26:10592:x1876532858517120:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 503us (908us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1789601487.708137:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 133 00000100:00080000:0.0:1789601487.709171:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601487.712708:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601487.712802:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858517248 00000100:00100000:1.0:1789601487.712812:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858517248 00000100:00100000:1.0:1789601487.713114:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 134 00000100:00100000:1.0:1789601487.713126:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+26:10592:x1876532858517248:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:1.0:1789601487.713203:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac85c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601487.713222:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac85c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601487.713235:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac85c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601487.713281:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac85c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601487.713289:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac85c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601487.713296:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac85c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601487.713302:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601487.713306:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac85c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601487.713314:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac85c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601487.713328:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:1.0:1789601487.713330:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789601487.713336:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac85c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601487.713342:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac85c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601487.713432:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+26:10592:x1876532858517248:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 308us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601487.713439:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 134 00000100:00100000:3.0:1789601487.793964:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601487.794026:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858517376 00000100:00100000:2.0:1789601487.794036:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858517376 00000100:00100000:2.0:1789601487.794147:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:2.0:1789601487.794159:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858517376:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:2.0:1789601487.794177:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601487.794197:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a24cc6a/0xf3d6e402158ac863 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061203 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789601487.794224:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aab26cc, atime: 0x6aab26cc, ctime: 0x6aab26cc, blocks: 0xb 00010000:00010000:2.0:1789601487.794244:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=357s v=(0 0) 00010000:00010000:2.0:1789601487.794249:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601487.794259:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a24cc6a/0xf3d6e402158ac863 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061203 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601487.794279:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008a24cc6a/0xf3d6e402158ac863 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061203 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601487.794294:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8da00, rc 0) 00000100:00100000:2.0:1789601487.794362:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2356:x1876532858517376:12345-192.168.201.30@tcp:101:cat.0 Request processed in 206us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601487.794369:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:2.0:1789601487.798988:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601487.799089:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858517504 00000100:00100000:3.0:1789601487.799100:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858517504 00002000:00100000:3.0:1789601487.799165:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff91edffa8ed80 x1876532858517504/t0(0) o3->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:83/0 lens 488/0 e 0 to 0 dl 1789601498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789601487.799178:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91edffa8ed80 with x1876532858517504 ext(0->4095) 00002000:00010000:3.0:1789601487.799184:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91edffa8ed80 00000100:00100000:3.0:1789601487.799219:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:3.0:1789601487.799229:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2357:x1876532858517504:12345-192.168.201.30@tcp:3:cat.0 00000100:00100000:3.0:1789601487.799973:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2357:x1876532858517504:12345-192.168.201.30@tcp:3:cat.0 Request processed in 740us (989us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789601487.799983:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00002000:00100000:3.0:1789601487.799992:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff91edffa8ed80 x1876532858517504/t0(0) o3->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:83/0 lens 488/4536 e 0 to 0 dl 1789601498 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789601487.800023:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91edffa8ed80 with x1876532858517504 ext(0->4095) 00002000:00010000:3.0:1789601487.800027:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91edffa8ed80 00010000:00010000:2.0:1789601487.887896:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601488.841122:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880548480:0@lo:400:kworker.0 00000100:00100000:1.0:1789601488.841198:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601488.841354:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601488.841367:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880548352:0@lo:400:kworker.0 00000100:00100000:3.0:1789601488.841433:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601488.841488:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880548352 00000100:00100000:3.0:1789601488.841507:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880548352 00000100:00100000:3.0:1789601488.841563:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789601488.841574:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880548352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601488.841640:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880548352:12345-0@lo:400:kworker.0 Request processed in 67us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601488.841648:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789601488.841702:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880548352:0@lo:400:kworker.0 00000100:00100000:0.0:1789601488.845143:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880548480 00000100:00100000:0.0:1789601488.845160:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880548480 00000100:00100000:0.0:1789601488.845224:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789601488.845235:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880548480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601488.847748:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880548864:0@lo:400:kworker.0 00000100:00100000:2.0:1789601488.847823:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601488.847884:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789601488.847891:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880548736:0@lo:400:kworker.0 00000100:00100000:2.0:1789601488.847916:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601488.847951:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880548736 00000100:00100000:2.0:1789601488.847960:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880548736 00000100:00100000:2.0:1789601488.848032:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789601488.848041:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880548736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601488.848092:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880548736:12345-0@lo:400:kworker.0 Request processed in 52us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601488.848098:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1789601488.848124:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601488.848160:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880548736:0@lo:400:kworker.0 00000100:00100000:3.0:1789601488.848354:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880548864 00000100:00100000:3.0:1789601488.848359:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880548864 00000100:00100000:3.0:1789601488.848413:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789601488.848421:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880548864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601488.848474:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880548864:12345-0@lo:400:kworker.0 Request processed in 54us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601488.848481:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789601488.848528:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880548864:0@lo:400:kworker.0 00000100:00080000:2.0:1789601488.848823:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601488.848916:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880548480:12345-0@lo:400:kworker.0 Request processed in 3683us (7717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601488.848925:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789601488.851078:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880548608:0@lo:400:kworker.0 00000100:00100000:0.0:1789601488.851158:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601488.851214:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789601488.851221:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880548992:0@lo:400:kworker.0 00000100:00100000:0.0:1789601488.851249:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601488.851351:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880548608 00000100:00100000:3.0:1789601488.851361:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880548608 00000100:00100000:3.0:1789601488.851440:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789601488.851462:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880548608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601488.851549:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880548608:12345-0@lo:400:kworker.0 Request processed in 100us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601488.851555:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789601488.851601:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880548608:0@lo:400:kworker.0 00000100:00100000:2.0:1789601488.851864:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880548992 00000100:00100000:2.0:1789601488.851868:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880548992 00000100:00100000:2.0:1789601488.851911:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789601488.851919:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3320:x1876532880548992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601488.851974:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3320:x1876532880548992:12345-0@lo:400:kworker.0 Request processed in 47us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601488.851981:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1789601488.852099:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601488.852105:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601488.852169:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880548992:0@lo:400:kworker.0 00000100:00100000:1.0:1789601488.853889:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880548480:0@lo:400:kworker.0 00010000:00010000:3.0:1789601488.905068:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789601489.355009:0:8064:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359393169280ns, next at 360393166805ns, rc = 0 00000100:00100000:1.0:1789601489.355044:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880549120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601489.355140:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601489.355230:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880549120 00000100:00100000:1.0:1789601489.355238:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880549120 00000100:00100000:1.0:1789601489.355289:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789601489.355299:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1876532880549120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601489.355333:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601489.355389:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1876532880549120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601489.355396:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789601489.355442:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880549120:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789601489.450290:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000004:00080000:0.0:1789601489.450319:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:0.0:1789601489.450351:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1789601489.450380:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91edcc604840 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789601489.450385:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91edffc2af00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91edcc6046c0 00000020:00080000:0.0:1789601489.450387:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91edffc2ad00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91edf7e7c000 00000020:00080000:0.0:1789601489.450408:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1789601489.450445:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789601489.450898:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:3.0:1789601489.451105:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601489.451144:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880549248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789601489.451246:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601489.451934:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880549248 00000100:00100000:0.0:1789601489.451950:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880549248 00000100:00100000:0.0:1789601489.452023:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789601489.452040:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3318:x1876532880549248:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789601489.452302:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789601489.452305:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789601484 -> 1789601484 00002000:00010000:0.0:1789601489.452307:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1789601484 -> 1789601484 00002000:00010000:0.0:1789601489.452309:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789601484 -> 1789601484 00002000:00010000:0.0:1789601489.452311:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789601489.453394:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3318:x1876532880549248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1352us (2140us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789601489.453408:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:2.0:1789601489.458830:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91ee00421c00/2, rc 0, transno 4294967312 00000100:00100000:2.0:1789601489.458866:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880549248:0@lo:2:osp-syn-1-0.0 00000040:00080000:3.0:1789601489.673177:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789601489.673187:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789601489.673229:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789601489.673236:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789601489.932053:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789601489.960223:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1789601489.960254:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:3.0:1789601490.953589:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601491.413668:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601491.413723:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601491.413754:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601491.413773:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601491.413795:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601491.413826:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858518016 00000100:00100000:3.0:1789601491.413870:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858518016 00000100:00100000:3.0:1789601491.413935:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858517888 00000100:00100000:3.0:1789601491.413938:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858517888 00000100:00100000:3.0:1789601491.413966:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 87 00000100:00100000:3.0:1789601491.413977:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858518016:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789601491.414060:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858517760 00000100:00100000:1.0:1789601491.414065:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858517760 00000100:00100000:3.0:1789601491.414093:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858518016:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 118us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601491.414099:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858518144 00000100:00100000:1.0:1789601491.414101:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858518144 00000100:00100000:3.0:1789601491.414102:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 87 00000100:00100000:3.0:1789601491.414120:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 88 00000100:00100000:1.0:1789601491.414121:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 157 00000100:00100000:3.0:1789601491.414126:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2357:x1876532858517888:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789601491.414127:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:2357:x1876532858517760:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601491.414150:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2357:x1876532858517888:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601491.414152:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:2357:x1876532858517760:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601491.414156:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 88 00000100:00100000:1.0:1789601491.414158:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 157 00000100:00100000:3.0:1789601491.414174:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858517632 00000100:00100000:1.0:1789601491.414176:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 158 00000100:00100000:3.0:1789601491.414177:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858517632 00000100:00100000:1.0:1789601491.414183:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+5:2357:x1876532858518144:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601491.414199:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 294 00000100:00100000:3.0:1789601491.414206:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2357:x1876532858517632:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789601491.414206:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+5:2357:x1876532858518144:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601491.414228:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2357:x1876532858517632:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 23us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601491.414235:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 294 00000100:00080000:3.0:1789601491.414267:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601491.414272:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789601491.414274:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601491.414781:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 158 00000100:00100000:0.0:1789601491.915674:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880549376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601491.915757:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601491.924335:0:10225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880549376 00000100:00100000:0.0:1789601491.924354:0:10225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880549376 00000100:00100000:0.0:1789601491.924695:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789601491.924706:0:10225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880549376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789601491.924748:0:10225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789601491.924850:0:10225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880549376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (9079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601491.924858:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789601491.924914:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8bbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880549376:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789601491.932691:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789601491.977244:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601493.004194:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601493.961233:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf80a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880549632:0@lo:400:kworker.0 00000100:00100000:2.0:1789601493.961320:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601493.961388:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf80a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880550144:0@lo:400:kworker.0 00000100:00100000:2.0:1789601493.961429:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601493.961459:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789601493.961465:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edfff52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880549504:0@lo:400:kworker.0 00000100:00100000:2.0:1789601493.961490:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601493.961510:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf80a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880550016:0@lo:400:kworker.0 00000100:00100000:2.0:1789601493.961531:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601493.961747:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf80a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880549760:0@lo:400:kworker.0 00000100:00100000:0.0:1789601493.961782:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601493.961813:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601493.961819:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf80a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880549888:0@lo:400:kworker.0 00000100:00100000:0.0:1789601493.961873:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601493.961905:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880550144 00000100:00100000:0.0:1789601493.961913:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880550144 00000100:00100000:0.0:1789601493.961967:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880549888 00000100:00100000:0.0:1789601493.961971:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880549888 00000100:00100000:0.0:1789601493.961993:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789601493.962003:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880550144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601493.962054:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880550144:12345-0@lo:400:kworker.0 Request processed in 52us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601493.962061:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789601493.962081:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789601493.962087:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880549888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601493.962121:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880549888:12345-0@lo:400:kworker.0 Request processed in 34us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601493.962127:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1789601493.962143:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789601493.962148:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789601493.962182:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf80a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880549888:0@lo:400:kworker.0 00000100:00100000:0.0:1789601493.962220:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1789601493.962225:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91ee002e9f80, transno 4294967309 00000004:00080000:0.0:1789601493.962237:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967312 00000004:00080000:0.0:1789601493.962250:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91ee00421c00, transno 4294967312 00000100:00100000:0.0:1789601493.962256:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf80a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880550144:0@lo:400:kworker.0 00000100:00100000:3.0:1789601493.963736:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880549632 00000100:00100000:3.0:1789601493.963750:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880549632 00000100:00100000:3.0:1789601493.963810:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880550016 00000100:00100000:3.0:1789601493.963814:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880550016 00000100:00100000:3.0:1789601493.963862:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880549760 00000100:00100000:3.0:1789601493.963866:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880549760 00000100:00100000:3.0:1789601493.963884:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789601493.963891:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880549632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601493.963988:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880549632:12345-0@lo:400:kworker.0 Request processed in 98us (2668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601493.963996:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789601493.964013:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789601493.964019:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880550016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601493.964047:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880550016:12345-0@lo:400:kworker.0 Request processed in 29us (2516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601493.964052:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789601493.964063:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789601493.964068:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880549760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601493.964102:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880549760:12345-0@lo:400:kworker.0 Request processed in 35us (2319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601493.964108:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789601493.964129:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880549504 00000100:00100000:3.0:1789601493.964133:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880549504 00000100:00100000:3.0:1789601493.964155:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1789601493.964161:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880549504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601493.964192:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880549504:12345-0@lo:400:kworker.0 Request processed in 31us (2701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601493.964197:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1789601493.964247:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf80a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880549760:0@lo:400:kworker.0 00000100:00080000:0.0:1789601493.965035:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601493.975594:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edfff52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880549504:0@lo:400:kworker.0 00000100:00100000:3.0:1789601493.975623:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf80a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880550016:0@lo:400:kworker.0 00000100:00100000:3.0:1789601493.975635:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf80a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880549632:0@lo:400:kworker.0 00010000:00010000:2.0:1789601494.025142:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601494.138139:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601494.138349:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858518272 00000100:00100000:3.0:1789601494.138374:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858518272 00000100:00100000:3.0:1789601494.138494:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 135 00000100:00100000:3.0:1789601494.138510:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:10234:x1876532858518272:12345-192.168.201.30@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789601494.138669:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:10234:x1876532858518272:12345-192.168.201.30@tcp:60:lhsmtool_posix.0 Request processed in 164us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601494.138678:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 135 00000100:00080000:0.0:1789601494.139014:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601494.146622:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601494.146922:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858518528 00000100:00100000:2.0:1789601494.146937:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858518528 00000100:00100000:2.0:1789601494.147032:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:2.0:1789601494.147179:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:10234:x1876532858518528:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789601494.150137:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:10234:x1876532858518528:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 3083us (3521us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789601494.150152:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:1.0:1789601494.473700:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880550272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601494.473816:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601494.473987:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880550272 00000100:00100000:1.0:1789601494.473999:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880550272 00000100:00100000:1.0:1789601494.474074:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789601494.474089:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880550272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601494.474145:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601494.474217:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00422300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880550272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601494.474228:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789601494.474312:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880550272:0@lo:13:osp-pre-1-0.0 00000020:00080000:1.0:1789601494.534171:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1789601494.534211:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1789601494.534280:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789601494.534297:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1789601495.051781:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601496.073232:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601496.540616:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601496.540695:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601496.540740:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858518784 00000100:00100000:1.0:1789601496.540754:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858518784 00000100:00100000:1.0:1789601496.540875:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 162 00000100:00100000:1.0:1789601496.540888:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:2359:x1876532858518784:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789601496.541025:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:2359:x1876532858518784:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 138us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601496.541050:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 162 00000100:00100000:3.0:1789601496.541225:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858518656 00000100:00100000:3.0:1789601496.541247:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858518656 00000100:00100000:3.0:1789601496.541306:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 296 00000100:00100000:3.0:1789601496.541317:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2359:x1876532858518656:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601496.541403:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2359:x1876532858518656:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 88us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601496.541411:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 296 00000100:00100000:3.0:1789601496.544971:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601496.545067:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601496.545160:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601496.545188:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858519040 00000100:00100000:3.0:1789601496.545197:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858519040 00000100:00100000:3.0:1789601496.545262:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858518912 00000100:00100000:3.0:1789601496.545266:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858518912 00000100:00100000:3.0:1789601496.545297:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 91 00000100:00100000:3.0:1789601496.545313:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2358:x1876532858519040:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789601496.545330:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:1.0:1789601496.545356:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2358:x1876532858518912:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789601496.545483:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2358:x1876532858518912:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 138us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601496.545493:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:3.0:1789601496.545512:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2358:x1876532858519040:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 201us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601496.545539:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 91 00000100:00100000:3.0:1789601496.545573:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858519168 00000100:00100000:3.0:1789601496.545577:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858519168 00000100:00100000:3.0:1789601496.545613:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 163 00000100:00100000:3.0:1789601496.545623:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85db4f7d-704a-4080-a137-b2930e072a8c+5:2358:x1876532858519168:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601496.545885:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85db4f7d-704a-4080-a137-b2930e072a8c+5:2358:x1876532858519168:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 264us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601496.545892:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 163 00000100:00080000:1.0:1789601496.547362:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789601496.547376:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601496.547382:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1789601496.840681:0:12339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 19:31:36 (1789601496) 00000100:00100000:1.0:1789601497.036057:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789601497.036089:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880550400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601497.036187:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601497.036283:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880550400 00000100:00100000:1.0:1789601497.036295:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880550400 00000100:00100000:1.0:1789601497.036367:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789601497.036378:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880550400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601497.036426:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601497.036481:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880550400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601497.036488:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1789601497.036514:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601497.036562:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880550400:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789601497.097272:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601498.121074:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601498.947084:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601498.948050:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858519424 00000100:00100000:2.0:1789601498.948067:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858519424 00000100:00100000:2.0:1789601498.948223:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 136 00000100:00100000:2.0:1789601498.948237:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:11304:x1876532858519424:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601498.948266:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601498.948317:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac86a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506120a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.948453:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac871 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.948472:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac871 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.948488:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac871 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.948505:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac878 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.948512:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac878 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.948519:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac878 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.948832:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac87f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.949667:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac87f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.949679:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac87f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601498.949696:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789601498.950261:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac871 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.951630:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac871 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.951671:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac871 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.951678:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c400 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601498.951684:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac871 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.951695:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac871 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.951716:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91edd8a67e00) 00010000:00010000:2.0:1789601498.951720:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601498.951727:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac871 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.951733:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac871 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.951757:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac878 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.951763:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac878 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.951769:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac878 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.951774:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601498.951777:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac878 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.951794:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac878 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.951804:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91edd8a67c00) 00010000:00010000:2.0:1789601498.951806:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601498.951810:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac878 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.951816:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac878 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789601498.954538:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789601498.955663:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ac86a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506120a expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.955701:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac87f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506120a expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.955712:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91edd35e8700) 00010000:00010000:2.0:1789601498.955716:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601498.955720:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8ce00, rc 0) 00000100:00100000:2.0:1789601498.955858:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+15:11304:x1876532858519424:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 7605us (8771us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789601498.955870:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 136 00000100:00100000:1.0:1789601498.962407:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601498.963027:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858519552 00000100:00100000:2.0:1789601498.963043:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858519552 00000100:00100000:2.0:1789601498.963144:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:2.0:1789601498.963157:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+15:2359:x1876532858519552:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601498.963211:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601498.963253:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158ac87f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506120a expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601498.963285:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91edd35e8700) 00010000:00010000:2.0:1789601498.963292:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601498.963394:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:2359:x1876532858519552:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 240us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601498.963402:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:1.0:1789601498.967469:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601498.967663:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858519680 00000100:00100000:3.0:1789601498.967677:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858519680 00000100:00100000:3.0:1789601498.967762:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 137 00000100:00100000:3.0:1789601498.967774:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:11304:x1876532858519680:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789601498.967965:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:11304:x1876532858519680:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 Request processed in 192us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601498.967973:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 137 00000100:00100000:0.0:1789601499.081417:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8bbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880550912:0@lo:400:kworker.0 00000100:00100000:0.0:1789601499.081523:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601499.081613:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601499.081620:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880550784:0@lo:400:kworker.0 00000100:00100000:0.0:1789601499.081652:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601499.081693:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880550912 00000100:00100000:0.0:1789601499.081703:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880550912 00000100:00100000:0.0:1789601499.081783:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789601499.081794:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880550912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601499.082276:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880550656:0@lo:400:kworker.0 00000100:00100000:3.0:1789601499.082322:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601499.082366:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8bbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880551168:0@lo:400:kworker.0 00000100:00100000:3.0:1789601499.082390:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601499.082420:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789601499.082427:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880550528:0@lo:400:kworker.0 00000100:00100000:3.0:1789601499.082459:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601499.082483:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8bbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880551040:0@lo:400:kworker.0 00000100:00100000:3.0:1789601499.082527:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601499.082559:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880551168 00000100:00100000:3.0:1789601499.082564:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880551168 00000100:00100000:3.0:1789601499.082596:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789601499.082603:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880551168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601499.082641:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880551168:12345-0@lo:400:kworker.0 Request processed in 38us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601499.082648:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789601499.082677:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880550528 00000100:00100000:3.0:1789601499.082681:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880550528 00000100:00100000:3.0:1789601499.082703:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789601499.082709:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880550528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601499.082737:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880550528:12345-0@lo:400:kworker.0 Request processed in 28us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601499.082743:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789601499.082780:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880550784 00000100:00100000:3.0:1789601499.082783:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880550784 00000100:00080000:2.0:1789601499.087589:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789601499.087606:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789601499.087609:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601499.089149:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880550656 00000100:00100000:3.0:1789601499.089171:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880550656 00000100:00100000:0.0:1789601499.089378:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880550912:12345-0@lo:400:kworker.0 Request processed in 7577us (7845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601499.089393:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789601499.090030:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880551040 00000100:00100000:2.0:1789601499.090040:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880551040 00000100:00100000:2.0:1789601499.090101:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789601499.090112:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880550784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601499.090581:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880550784:12345-0@lo:400:kworker.0 Request processed in 469us (8924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601499.090589:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789601499.090696:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789601499.090708:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880550656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601499.090748:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880550656:12345-0@lo:400:kworker.0 Request processed in 44us (8426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601499.090755:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789601499.090769:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789601499.090775:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880551040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601499.090977:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880551040:12345-0@lo:400:kworker.0 Request processed in 201us (8447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601499.090984:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:2.0:1789601499.091011:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601499.091091:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8bbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880550528:0@lo:400:kworker.0 00000100:00100000:2.0:1789601499.091108:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8bbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880551040:0@lo:400:kworker.0 00000100:00100000:2.0:1789601499.091128:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880550656:0@lo:400:kworker.0 00000100:00100000:2.0:1789601499.091143:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8bbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880551168:0@lo:400:kworker.0 00000100:00100000:1.0:1789601499.093565:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880550784:0@lo:400:kworker.0 00000100:00100000:1.0:1789601499.093587:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8bbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880550912:0@lo:400:kworker.0 00010000:00010000:3.0:1789601499.147983:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601499.593108:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601499.593154:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880551296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601499.593263:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601499.593611:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880551296 00000100:00100000:1.0:1789601499.593641:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880551296 00000100:00100000:1.0:1789601499.593708:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789601499.593719:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880551296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601499.593766:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601499.593830:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880551296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601499.593865:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789601499.599990:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880551296:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789601499.679272:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000040:00080000:1.0:1789601499.913361:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601499.913372:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601499.914193:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1789601499.914203:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789601500.171077:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601501.201000:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601501.384765:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601501.384878:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858519808 00000100:00100000:3.0:1789601501.384890:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858519808 00000100:00100000:3.0:1789601501.384972:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 138 00000100:00100000:3.0:1789601501.384992:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:11346:x1876532858519808:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601501.385013:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601501.385072:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac88d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061211 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385132:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac894 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385144:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac894 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385170:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac894 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385184:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac89b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385190:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac89b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385195:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac89b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385454:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac894 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385463:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac894 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385470:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac894 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385496:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadce00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601501.385501:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac894 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385508:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac894 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385522:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8a67100) 00010000:00010000:3.0:1789601501.385526:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601501.385716:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac894 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385725:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac894 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385740:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac89b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385746:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac89b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385751:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac89b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385756:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601501.385759:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac89b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385764:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac89b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385783:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91edd8ce5c00) 00010000:00010000:3.0:1789601501.385786:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601501.385789:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac89b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385795:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac89b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385871:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac88d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061211 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385882:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8a67100) 00010000:00010000:3.0:1789601501.385884:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601501.385888:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac88d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061211 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.385900:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadca00, rc 0) 00000100:00100000:3.0:1789601501.385970:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:11346:x1876532858519808:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 980us (1216us total) trans 0 rc 301/301 00000100:00100000:3.0:1789601501.385977:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 138 00000100:00080000:0.0:1789601501.386546:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601501.419332:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601501.419948:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858520064 00000100:00100000:2.0:1789601501.419961:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858520064 00000100:00100000:2.0:1789601501.421140:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 139 00000100:00100000:2.0:1789601501.421169:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:11346:x1876532858520064:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:2.0:1789601501.421232:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601501.421261:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158ac219 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061051 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.421279:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8a67100) 00010000:00010000:2.0:1789601501.421289:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601501.421501:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac8a2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.421516:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac8a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.421527:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac8a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.421624:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac8a9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.421633:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.421640:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601501.427832:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789601501.427876:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac8a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.427887:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac8a2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.427895:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac8a2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.427901:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601501.427906:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac8a2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.427913:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac8a2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.427931:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8a67200) 00010000:00010000:2.0:1789601501.427935:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601501.427940:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac8a2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.427960:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ac8a2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601501.427979:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdc63e12 reply state 00000000db555966 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601501.427988:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789601501.428092:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:11346:x1876532858520064:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 6927us (8768us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1789601501.428101:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 139 00010000:00010000:2.0:1789601501.432044:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac8a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.432063:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac8a9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.432070:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac8a9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.432076:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c400 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601501.432081:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac8a9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.432089:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac8a9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.432107:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91edd8a67b00) 00010000:00010000:2.0:1789601501.432110:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601501.432115:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac8a9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.432142:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ac8a9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601501.622408:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601501.622496:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858520192 00000100:00100000:3.0:1789601501.622507:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858520192 00000100:00100000:3.0:1789601501.622601:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 140 00000100:00100000:3.0:1789601501.622613:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:11354:x1876532858520192:12345-192.168.201.30@tcp:101:lctl.0 00010000:00010000:3.0:1789601501.622637:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601501.622663:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac8b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061218 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.622762:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac8b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.622779:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac8b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.622792:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac8b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601501.622833:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789601501.622857:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789601501.622883:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac8b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.622906:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac8b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061218 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.622926:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac8b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061218 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.622935:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8ce5c00) 00010000:00010000:3.0:1789601501.622938:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601501.622942:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc800, rc 0) 00000100:00100000:3.0:1789601501.623010:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:11354:x1876532858520192:12345-192.168.201.30@tcp:101:lctl.0 Request processed in 399us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601501.623017:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 140 00000100:00100000:2.0:1789601501.657077:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601501.657130:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601501.657164:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858520320 00000100:00100000:2.0:1789601501.657167:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858520576 00000100:00100000:3.0:1789601501.657174:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858520320 00000100:00100000:2.0:1789601501.657174:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858520576 00000100:00100000:3.0:1789601501.657225:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 298 00000100:00100000:2.0:1789601501.657225:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 95 00000100:00100000:3.0:1789601501.657235:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2357:x1876532858520320:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601501.657235:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858520576:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601501.657296:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858520576:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 62us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601501.657303:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 95 00000100:00080000:0.0:1789601501.658228:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601501.673536:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2357:x1876532858520320:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 16289us (16457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601501.673551:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 298 00000100:00100000:2.0:1789601501.676938:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601501.676980:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858520448 00000100:00100000:2.0:1789601501.676989:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858520448 00000100:00100000:2.0:1789601501.678207:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 96 00000100:00100000:2.0:1789601501.678221:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2357:x1876532858520448:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601501.680672:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2357:x1876532858520448:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 2443us (3732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601501.680689:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 96 00000100:00080000:2.0:1789601501.680733:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601501.680798:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601501.680898:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858520704 00000100:00100000:2.0:1789601501.680908:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858520704 00000100:00100000:2.0:1789601501.680956:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 167 00000100:00100000:2.0:1789601501.680965:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85db4f7d-704a-4080-a137-b2930e072a8c+5:2357:x1876532858520704:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601501.681115:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:85db4f7d-704a-4080-a137-b2930e072a8c+5:2357:x1876532858520704:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 151us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601501.681123:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 167 00000100:00080000:2.0:1789601501.681139:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601501.719055:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601501.719082:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858520832 00000100:00100000:3.0:1789601501.719090:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858520832 00000100:00100000:3.0:1789601501.719134:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 141 00000100:00100000:3.0:1789601501.719156:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:11360:x1876532858520832:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789601501.719184:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601501.719209:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac8be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506121f expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719278:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719294:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719307:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719325:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719332:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719342:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719454:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac8d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719463:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719470:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601501.719499:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789601501.719502:0:8248:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789601501.719522:0:8248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac8d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719535:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719541:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719547:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719553:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadce00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601501.719557:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719564:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719576:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8ce5c00) 00010000:00010000:3.0:1789601501.719584:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601501.719590:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719596:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719609:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719614:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719619:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719624:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601501.719627:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719633:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719641:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91edd8ce5f00) 00010000:00010000:3.0:1789601501.719643:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601501.719646:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719651:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719683:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac8be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506121f expref: 16 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719710:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac8d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506121f expref: 15 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.719717:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:3.0:1789601501.719720:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789601501.719722:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffaddc00, rc 0) 00000100:00100000:3.0:1789601501.719797:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+15:11360:x1876532858520832:12345-192.168.201.30@tcp:101:bash.0 Request processed in 655us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601501.719804:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 141 00000100:00100000:2.0:1789601501.732703:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601501.733373:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858521088 00000100:00100000:3.0:1789601501.733384:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858521088 00000100:00100000:3.0:1789601501.733480:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 142 00000100:00100000:3.0:1789601501.733491:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+15:11360:x1876532858521088:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789601501.733516:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601501.733548:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac8da lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061226 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.733688:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.733706:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.733719:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.734173:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.734197:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.734205:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789601501.738000:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1789601501.738380:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac8ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.738399:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac8ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.738412:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac8ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.738454:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.738462:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.738469:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.738475:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601501.738479:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.738487:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.738517:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:3.0:1789601501.738519:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601501.738599:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.738606:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac8e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601501.738621:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca1c637d reply state 000000009d2582b6 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601501.738630:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789601501.738671:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158ac8da lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061226 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.738685:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac8ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061226 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.738694:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5600) 00010000:00010000:3.0:1789601501.738696:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601501.738698:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc200, rc 0) 00000100:00100000:3.0:1789601501.739049:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:11360:x1876532858521088:12345-192.168.201.30@tcp:101:bash.0 Request processed in 5557us (6354us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789601501.739058:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 142 00010000:00010000:0.0:1789601501.743811:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601501.743831:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601501.743870:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601501.743877:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadce00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601501.743882:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601501.743890:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601501.743908:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91edd8ce5f00) 00010000:00010000:0.0:1789601501.743911:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601501.743915:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601501.743922:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac8e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601501.746379:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601501.746681:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858521216 00000100:00100000:3.0:1789601501.746692:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858521216 00000100:00100000:3.0:1789601501.746766:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:3.0:1789601501.746778:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2357:x1876532858521216:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789601501.746812:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601501.746871:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d52cbd70/0xf3d6e402158ac8fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506122d expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789601501.746900:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601501.746922:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=371s v=(0 0) 00010000:00010000:3.0:1789601501.746927:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601501.746936:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d52cbd70/0xf3d6e402158ac8fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506122d expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.746957:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d52cbd70/0xf3d6e402158ac8fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506122d expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.746971:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc400, rc 0) 00000100:00100000:3.0:1789601501.747045:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858521216:12345-192.168.201.30@tcp:101:bash.0 Request processed in 270us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601501.747053:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:2.0:1789601501.752757:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601501.752921:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858521344 00000100:00100000:3.0:1789601501.752932:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858521344 00000100:00100000:3.0:1789601501.752984:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:3.0:1789601501.752993:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:11360:x1876532858521344:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789601501.753013:0:11670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601501.753032:0:11670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac904 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061234 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.753066:0:11670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d52cbd70/0xf3d6e402158ac8fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506122d expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.753102:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601501.753106:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601501.753112:0:11670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac904 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061234 expref: 7 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.753155:0:11670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d52cbd70/0xf3d6e402158ac8fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506122d expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.753169:0:11670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d52cbd70/0xf3d6e402158ac8fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506122d expref: 7 pid: 6677 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601501.753184:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf80a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11670:1876532880551424:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789601501.753281:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc3911d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789601501.757719:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601501.757960:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf80a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11670:1876532880551424:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601501.758005:0:11670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac904 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061234 expref: 7 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.758029:0:11670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadca00, rc 0) 00000100:00100000:3.0:1789601501.758101:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:11360:x1876532858521344:12345-192.168.201.30@tcp:101:bash.0 Request processed in 5108us (5355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601501.758111:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:2.0:1789601501.759883:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858521472 00000100:00100000:2.0:1789601501.759896:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858521472 00010000:00010000:2.0:1789601501.759942:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d52cbd70/0xf3d6e402158ac8fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506122d expref: 7 pid: 6677 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601501.759986:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:2.0:1789601501.759995:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2356:x1876532858521472:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601501.760008:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601501.760031:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d52cbd70/0xf3d6e402158ac8fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506122d expref: 7 pid: 6677 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.760043:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d52cbd70/0xf3d6e402158ac8fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506122d expref: 7 pid: 6677 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.760065:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d52cbd70/0xf3d6e402158ac8fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506122d expref: 7 pid: 6677 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.760081:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601501.760085:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601501.760106:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac904 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061234 expref: 6 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.760116:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac904 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061234 expref: 6 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601501.760167:0:8437:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac904 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061234 expref: 6 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601501.760182:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8437:1876532880551552:192.168.201.30@tcp:105: 00000100:00100000:2.0:1789601501.760275:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc96046c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601501.766324:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601501.766352:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a59c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8437:1876532880551552:192.168.201.30@tcp:105: 00010000:00010000:2.0:1789601501.766380:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601501.766449:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858521472:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 6454us (8739us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601501.766461:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:0.0:1789601501.766463:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858521728 00000100:00100000:0.0:1789601501.766472:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858521728 00000100:00100000:0.0:1789601501.766545:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:0.0:1789601501.766555:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+17:11360:x1876532858521728:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:0.0:1789601501.766941:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:11360:x1876532858521728:12345-192.168.201.30@tcp:35:bash.0 Request processed in 386us (636us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1789601501.766948:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:1.0:1789601501.916336:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601501.916434:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858521984 00000100:00100000:3.0:1789601501.916445:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858521984 00000100:00100000:3.0:1789601501.916517:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 143 00000100:00100000:3.0:1789601501.916552:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:11370:x1876532858521984:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601501.916583:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601501.916606:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac90b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506123b expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601501.916698:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789601501.916827:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac90b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506123b expref: 20 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.916894:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8ce5c00) 00010000:00010000:3.0:1789601501.916898:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601501.916904:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac90b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506123b expref: 20 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601501.916919:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc600, rc 0) 00000100:00100000:3.0:1789601501.916980:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:11370:x1876532858521984:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 430us (656us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1789601501.916988:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 143 00000100:00100000:1.0:1789601501.920959:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601501.921061:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858522240 00000100:00100000:0.0:1789601501.921072:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858522240 00000100:00100000:0.0:1789601501.921132:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:0.0:1789601501.921168:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:11370:x1876532858522240:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1789601501.921438:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:11370:x1876532858522240:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 272us (487us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1789601501.921446:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:1.0:1789601502.020281:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601502.020366:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858522368 00000100:00100000:2.0:1789601502.020376:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858522368 00000100:00100000:2.0:1789601502.020440:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 144 00000100:00100000:2.0:1789601502.020451:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:11376:x1876532858522368:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789601502.020479:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601502.020500:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac919 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061242 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.020568:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac920 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.020596:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.020608:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601502.020640:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789601502.020643:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789601502.020655:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac920 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.020682:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac919 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061242 expref: 22 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.020700:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac920 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061242 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.020706:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:2.0:1789601502.020709:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789601502.020712:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8c600, rc 0) 00000100:00100000:2.0:1789601502.020777:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:11376:x1876532858522368:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 328us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601502.020785:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 144 00000100:00100000:1.0:1789601502.024557:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601502.024636:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858522624 00000100:00100000:3.0:1789601502.024647:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858522624 00000100:00100000:3.0:1789601502.024711:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 145 00000100:00100000:3.0:1789601502.024721:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:11376:x1876532858522624:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601502.024741:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601502.024763:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac927 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061249 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.024908:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac92e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.024930:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac92e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.024939:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac92e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601502.024948:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789601502.025057:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158ac927 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061249 expref: 24 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.025071:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac92e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061249 expref: 23 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.025076:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5600) 00010000:00010000:3.0:1789601502.025079:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601502.025081:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc400, rc 0) 00000100:00100000:3.0:1789601502.025129:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+23:11376:x1876532858522624:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 408us (581us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1789601502.025145:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 145 00000100:00100000:1.0:1789601502.028720:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601502.028766:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601502.028899:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858523008 00000100:00100000:2.0:1789601502.028907:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858523008 00000100:00100000:2.0:1789601502.028960:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:2.0:1789601502.028968:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+23:2359:x1876532858523008:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601502.028980:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601502.029011:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ac92e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061249 expref: 23 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.029026:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5600) 00010000:00010000:2.0:1789601502.029030:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601502.029075:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:2359:x1876532858523008:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 109us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601502.029080:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:3.0:1789601502.036050:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858522880 00000100:00100000:3.0:1789601502.036068:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858522880 00000100:00100000:3.0:1789601502.036132:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 146 00000100:00100000:3.0:1789601502.036154:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:11376:x1876532858522880:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601502.036177:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601502.036199:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac93c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061250 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.036503:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac943 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.036518:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac943 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.036529:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac943 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601502.036542:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789601502.037002:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ac93c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061250 expref: 25 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.037023:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac943 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061250 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.037031:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5600) 00010000:00010000:3.0:1789601502.037034:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789601502.037038:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88600, rc 0) 00000100:00100000:3.0:1789601502.037171:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+24:11376:x1876532858522880:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1017us (8402us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1789601502.037180:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 146 00000100:00100000:1.0:1789601502.043473:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601502.043564:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858523136 00000100:00100000:3.0:1789601502.043576:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858523136 00000100:00100000:3.0:1789601502.043644:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:3.0:1789601502.043654:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858523136:12345-192.168.201.30@tcp:1:lfs.0 00010000:00010000:3.0:1789601502.043960:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000035c2f45/0xf3d6e402158ac951 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.043996:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac904 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061234 expref: 6 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.044006:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789601502.044010:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789601502.044015:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000035c2f45/0xf3d6e402158ac951 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.044050:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac904 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061234 expref: 6 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.044065:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac904 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061234 expref: 6 pid: 11670 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601502.044081:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf80a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1876532880551680:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789601502.044236:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd038e900 going to sleep for 11 seconds 00000100:00100000:3.0:1789601502.058380:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf80a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1876532880551680:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601502.058412:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000035c2f45/0xf3d6e402158ac951 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601502.058454:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601502.058509:0:12049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858523264 00000100:00100000:3.0:1789601502.058515:0:12049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858523264 00002000:00100000:3.0:1789601502.058574:0:12049:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff91edc8312a00 x1876532858523264/t0(0) o4->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:98/0 lens 504/0 e 0 to 0 dl 1789601513 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789601502.058609:0:12049:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91edc8312a00 with x1876532858523264 ext(0->12) 00010000:00010000:3.0:1789601502.058618:0:12049:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac904 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061234 expref: 7 pid: 11670 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.058634:0:12049:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac904 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061234 expref: 7 pid: 11670 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789601502.058642:0:12049:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91edc8312a00 00000100:00100000:3.0:1789601502.058681:0:12049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:3.0:1789601502.058691:0:12049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8312a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2357:x1876532858523264:12345-192.168.201.30@tcp:4:lfs.0 00000100:00100000:3.0:1789601502.059708:0:12049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8312a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:2357:x1876532858523264:12345-192.168.201.30@tcp:4:lfs.0 Request processed in 1011us (1450us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789601502.059718:0:12049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00002000:00100000:3.0:1789601502.059727:0:12049:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff91edc8312a00 x1876532858523264/t4294967305(0) o4->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:98/0 lens 504/448 e 0 to 0 dl 1789601513 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789601502.059748:0:12049:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91edc8312a00 with x1876532858523264 ext(0->12) 00010000:00010000:3.0:1789601502.059756:0:12049:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac904 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061234 expref: 9 pid: 11670 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.059770:0:12049:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac904 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061234 expref: 9 pid: 11670 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789601502.059778:0:12049:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91edc8312a00 00000100:00100000:0.0:1789601502.063983:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601502.064183:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858523392 00000100:00100000:3.0:1789601502.064206:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858523392 00010000:00010000:3.0:1789601502.064337:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac904 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061234 expref: 9 pid: 11670 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601502.064376:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:3.0:1789601502.064383:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:2358:x1876532858523392:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601502.064401:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789601502.064423:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789601502.064426:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789601502 00002000:00010000:3.0:1789601502.064429:0:5824:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789601503 00002000:00010000:3.0:1789601502.064431:0:5824:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789601502 00010000:00010000:3.0:1789601502.064437:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac904 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061234 expref: 9 pid: 11670 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.064452:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac904 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061234 expref: 9 pid: 11670 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.064473:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014fc9751/0xf3d6e402158ac904 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061234 expref: 9 pid: 11670 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.064487:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789601502.064490:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789601502.064495:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000035c2f45/0xf3d6e402158ac951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.064502:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000035c2f45/0xf3d6e402158ac951 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.065385:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601502.065449:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2358:x1876532858523392:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1062us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601502.065459:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00010000:00010000:0.0:1789601502.070880:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000035c2f45/0xf3d6e402158ac951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.070901:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000035c2f45/0xf3d6e402158ac951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.070942:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000035c2f45/0xf3d6e402158ac951 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.070952:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000035c2f45/0xf3d6e402158ac951 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.070961:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000035c2f45/0xf3d6e402158ac951 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.070968:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89e00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601502.070972:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000035c2f45/0xf3d6e402158ac951 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.070982:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000035c2f45/0xf3d6e402158ac951 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.071025:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000035c2f45/0xf3d6e402158ac951 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.071035:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000035c2f45/0xf3d6e402158ac951 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601502.071130:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2357:x1876532858523136:12345-192.168.201.30@tcp:1:lfs.0 Request processed in 27474us (27664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601502.072150:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:0.0:1789601502.079697:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601502.080085:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858523648 00000100:00100000:2.0:1789601502.080098:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858523648 00000100:00100000:2.0:1789601502.080174:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:2.0:1789601502.080185:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91eddcdafc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+24:11376:x1876532858523648:12345-192.168.201.30@tcp:35:lfs.0 00000004:00010000:2.0:1789601502.080262:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac943 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061250 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789601502.080529:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1789601502.080576:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1789601502.082704:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1789601502.083132:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac958 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.083162:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac8ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061226 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.083172:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac958 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.083295:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac8ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061226 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.083328:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac8ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061226 expref: 28 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601502.083344:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a59c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1876532880551808:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789601502.083511:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc96046c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601502.088001:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a59c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1876532880551808:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789601502.088036:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac958 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601502.088317:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601502.089585:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858523776 00000100:00100000:2.0:1789601502.089601:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858523776 00010000:00010000:2.0:1789601502.089651:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac8ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061226 expref: 29 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601502.089752:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:2.0:1789601502.089762:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8310380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+29:2356:x1876532858523776:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601502.089783:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601502.089790:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac8ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061226 expref: 29 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.089803:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac8ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061226 expref: 29 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.089826:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ac8ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061226 expref: 29 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.089893:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5600) 00010000:00010000:2.0:1789601502.089900:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac958 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.089910:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac958 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.089918:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac958 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.089956:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601502.090015:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8310380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+28:2356:x1876532858523776:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 254us (1699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601502.090023:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00010000:00010000:3.0:1789601502.091442:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac958 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.091458:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac958 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601502.091588:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1789601502.091982:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1789601502.092102:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf80a6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1876532880551936:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789601502.092175:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601502.092367:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880551936 00000100:00100000:1.0:1789601502.092376:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880551936 00000100:00100000:1.0:1789601502.092431:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789601502.092457:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1876532880551936:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789601502.092526:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1876532880551936:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 72us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601502.092533:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789601502.092554:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601502.092597:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc90fc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601502.092623:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf80a6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1876532880551936:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789601502.093811:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1789601502.094016:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf80a6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1876532880552064:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789601502.094076:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601502.094164:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8080f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601502.094399:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880552064 00000100:00100000:1.0:1789601502.094407:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880552064 00000100:00100000:1.0:1789601502.094498:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789601502.094506:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1876532880552064:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789601502.094703:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1876532880552064:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 197us (626us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789601502.094712:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789601502.094788:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf80a6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1876532880552064:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789601502.094899:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1789601502.094946:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac958 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.094957:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac958 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.094980:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac958 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.094987:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601502.094992:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac958 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.095001:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac958 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.095017:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5600) 00010000:00010000:3.0:1789601502.095021:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789601502.095025:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac958 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.095032:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac958 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789601502.095293:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789601502.095439:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1789601502.095454:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372133615737ns, next at 373133613162ns, rc = 0 00000001:00080000:3.0:1789601502.095461:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1789601502.095498:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5600) 00010000:00010000:3.0:1789601502.095502:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789601502.095509:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac943 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061250 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601502.095632:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91eddcdafc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+31:11376:x1876532858523648:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 15449us (15945us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1789601502.095655:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00000020:00080000:3.0:1789601502.095659:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789601502.099001:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601502.099154:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858523904 00000100:00100000:3.0:1789601502.099165:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858523904 00000100:00100000:3.0:1789601502.099240:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 147 00000100:00100000:3.0:1789601502.099251:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+31:11376:x1876532858523904:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601502.099289:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601502.099317:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac95f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061257 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.099381:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac95f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061257 expref: 32 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.099406:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac95f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061257 expref: 32 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.099428:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:3.0:1789601502.099431:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789601502.099435:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b89000, rc 0) 00000100:00100000:3.0:1789601502.099518:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+32:11376:x1876532858523904:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 268us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601502.099525:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 147 00000100:00100000:1.0:1789601502.108355:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601502.108526:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858524160 00000100:00100000:2.0:1789601502.108537:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858524160 00000100:00100000:2.0:1789601502.108630:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:2.0:1789601502.108641:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+32:11376:x1876532858524160:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789601502.108958:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+33:11376:x1876532858524160:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 317us (611us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1789601502.108965:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:2.0:1789601502.155697:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601502.155725:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880552192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601502.155806:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601502.155977:0:10225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880552192 00000100:00100000:1.0:1789601502.155990:0:10225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880552192 00000100:00100000:1.0:1789601502.156046:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789601502.156056:0:10225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1876532880552192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601502.156081:0:10225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601502.156169:0:10225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3317:x1876532880552192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601502.156177:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789601502.156277:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880552192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601502.207157:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601502.207259:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858524416 00000100:00100000:2.0:1789601502.207286:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858524416 00000100:00100000:2.0:1789601502.207348:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 148 00000100:00100000:2.0:1789601502.207359:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+33:11386:x1876532858524416:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789601502.207384:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601502.207417:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac966 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506125e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601502.207523:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789601502.207654:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac966 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506125e expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.207670:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8ce5c00) 00010000:00010000:2.0:1789601502.207674:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789601502.207679:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac966 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506125e expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.207696:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8cc00, rc 0) 00000100:00100000:2.0:1789601502.207764:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+34:11386:x1876532858524416:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 406us (629us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1789601502.207771:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 148 00000100:00100000:1.0:1789601502.211749:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601502.211869:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858524544 00000100:00100000:3.0:1789601502.211880:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858524544 00000100:00100000:2.0:1789601502.212066:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 149 00000100:00100000:2.0:1789601502.212077:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+34:11386:x1876532858524544:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:2.0:1789601502.212164:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac974 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.212181:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac974 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.212204:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac974 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.216380:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac97b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.216635:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac97b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.216650:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac97b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.216752:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac982 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.216761:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac982 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.216768:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac982 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601502.216830:0:8248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac982 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.216869:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac974 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.216876:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac974 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.216883:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac974 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.216907:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601502.216912:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac974 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.216920:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac974 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.216934:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:2.0:1789601502.216937:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601502.216943:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac974 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.216949:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac974 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.216964:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac97b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.216969:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac97b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.216975:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac97b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.216980:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8cc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601502.216982:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac97b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.216989:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac97b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.217012:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91edd8a67b00) 00010000:00010000:2.0:1789601502.217014:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601502.217018:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac97b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.217023:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac97b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.217038:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac982 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.217044:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac982 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.217050:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac982 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.217054:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601502.217057:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac982 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.217063:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac982 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.217069:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:2.0:1789601502.217071:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601502.217073:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac982 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.217078:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac982 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601502.217182:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9da8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+34:11386:x1876532858524544:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 5103us (5440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601502.217192:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 149 00010000:00010000:0.0:1789601502.218033:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601502.220420:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601502.220504:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858524800 00000100:00100000:3.0:1789601502.220672:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858524800 00000100:00100000:3.0:1789601502.221426:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:3.0:1789601502.221436:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+34:11386:x1876532858524800:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1789601502.224098:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+35:11386:x1876532858524800:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 2652us (3677us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1789601502.224110:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:1.0:1789601502.282010:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601502.282124:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858525056 00000100:00100000:2.0:1789601502.282161:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858525056 00000100:00100000:2.0:1789601502.282218:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 150 00000100:00100000:2.0:1789601502.282228:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+35:11389:x1876532858525056:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789601502.282262:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601502.282281:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac989 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061265 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282345:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac990 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282357:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac990 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282365:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac990 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282375:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac997 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282380:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac997 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282384:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac997 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282536:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac99e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282543:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac99e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282548:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac99e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601502.282556:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789601502.282657:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac990 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282665:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac990 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282671:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac990 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282677:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8cc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601502.282682:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac990 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282689:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac990 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282701:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:2.0:1789601502.282703:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601502.282721:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac990 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282737:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac990 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282755:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac997 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282760:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac997 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282766:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac997 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282771:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601502.282774:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac997 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282779:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac997 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282786:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91edd8a67b00) 00010000:00010000:2.0:1789601502.282789:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601502.282792:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac997 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282798:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac997 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282895:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac989 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061265 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282905:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac99e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061265 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.282917:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:2.0:1789601502.282918:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601502.282920:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8de00, rc 0) 00000100:00100000:2.0:1789601502.282974:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+37:11389:x1876532858525056:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 749us (975us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1789601502.282980:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 150 00000100:00100000:1.0:1789601502.290883:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601502.290981:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858525184 00000100:00100000:0.0:1789601502.290991:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858525184 00000100:00100000:0.0:1789601502.291029:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 151 00000100:00100000:0.0:1789601502.291035:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+37:11389:x1876532858525184:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:0.0:1789601502.291095:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac9ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.291110:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac9ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.291119:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac9ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.291151:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac9ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.291171:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac9ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.291175:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac9ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.291179:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601502.291182:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac9ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.291188:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac9ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.291196:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:0.0:1789601502.291198:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789601502.291201:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac9ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.291205:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925c00/0xf3d6e402158ac9ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601502.291270:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+37:11389:x1876532858525184:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 234us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601502.291275:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 151 00000100:00100000:1.0:1789601502.293992:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601502.294097:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858525440 00000100:00100000:2.0:1789601502.294106:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858525440 00000100:00100000:2.0:1789601502.294167:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:2.0:1789601502.294180:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+37:11389:x1876532858525440:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789601502.294412:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+38:11389:x1876532858525440:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 235us (426us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789601502.294419:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:3.0:1789601502.645019:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601502.645094:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858525696 00000100:00100000:2.0:1789601502.645103:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858525696 00000100:00100000:2.0:1789601502.645170:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 152 00000100:00100000:2.0:1789601502.645180:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+38:11420:x1876532858525696:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:2.0:1789601502.645206:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601502.645230:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac9b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506126c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.645406:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac9ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.645423:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac9ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.645451:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac9ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601502.645465:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789601502.645916:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac9b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506126c expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.645939:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac9ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506126c expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.645949:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:2.0:1789601502.645952:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601502.645955:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8d800, rc 0) 00000100:00100000:2.0:1789601502.646069:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+40:11420:x1876532858525696:12345-192.168.201.30@tcp:101:cat.0 Request processed in 890us (1234us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789601502.646077:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 152 00000100:00100000:1.0:1789601502.651290:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601502.652354:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601502.652962:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858526080 00000100:00100000:1.0:1789601502.652973:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858526080 00000100:00100000:1.0:1789601502.653033:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:1.0:1789601502.653040:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede51e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+40:2357:x1876532858526080:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601502.653052:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601502.653073:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158ac9ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506126c expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.653091:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:1.0:1789601502.653094:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601502.653212:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede51e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+39:2357:x1876532858526080:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 172us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601502.653220:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:2.0:1789601502.654827:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858525952 00000100:00100000:2.0:1789601502.654866:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858525952 00000100:00100000:2.0:1789601502.656961:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:2.0:1789601502.656977:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+39:11420:x1876532858525952:12345-192.168.201.30@tcp:35:cat.0 00000100:00100000:2.0:1789601502.657306:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+40:11420:x1876532858525952:12345-192.168.201.30@tcp:35:cat.0 Request processed in 332us (6025us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789601502.657315:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:3.0:1789601502.748991:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601502.755831:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858526336 00000100:00100000:0.0:1789601502.755862:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858526336 00000100:00100000:1.0:1789601502.756024:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 153 00000100:00100000:1.0:1789601502.756037:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+40:11426:x1876532858526336:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1789601502.756076:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601502.756079:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789601502.756108:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c600/0xf3d6e402158ac920 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061242 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.756140:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:1.0:1789601502.756145:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789601502.756160:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac9c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061273 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.756933:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac9cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.756968:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac99e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061265 expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.756976:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac9cf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.757013:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac99e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061265 expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.757028:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac99e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061265 expref: 40 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601502.757046:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1876532880552320:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789601502.757300:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc539fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601502.766108:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601502.766184:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858526464 00000100:00100000:2.0:1789601502.766237:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1876532880552320:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789601502.766261:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858526464 00010000:00010000:2.0:1789601502.766272:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac9cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601502.766373:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac99e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061265 expref: 41 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601502.768188:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:2.0:1789601502.768207:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+41:2357:x1876532858526464:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601502.768225:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601502.768234:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac99e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061265 expref: 41 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.768258:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac99e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061265 expref: 41 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.768281:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac99e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061265 expref: 41 pid: 5837 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.768299:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:2.0:1789601502.768304:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac9cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.768314:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac9cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.768322:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac9cf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.768363:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601502.768431:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+40:2357:x1876532858526464:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 232us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601502.768438:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00010000:00010000:1.0:1789601502.769051:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac9cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.769063:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac9cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601502.769085:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789601502.769257:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158ac9c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061273 expref: 41 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.769275:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac9cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061273 expref: 40 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601502.769301:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:1.0:1789601502.769303:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789601502.769307:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c5e00, rc 0) 00000100:00100000:1.0:1789601502.770726:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+40:11426:x1876532858526336:12345-192.168.201.30@tcp:101:dd.0 Request processed in 14623us (21675us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789601502.770737:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 153 00000100:00100000:1.0:1789601502.787960:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601502.788058:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858526720 00000100:00100000:3.0:1789601502.788071:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858526720 00000100:00100000:3.0:1789601502.788141:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 154 00000100:00100000:3.0:1789601502.788151:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+40:11426:x1876532858526720:12345-192.168.201.30@tcp:36:dd.0 00010000:00010000:3.0:1789601502.788446:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac9dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.788463:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac9dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601502.788475:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac9dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601502.788546:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1789601502.788572:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fcc3c74e reply state 00000000c569dc5c transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac9dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601502.788595:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789601502.788704:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8310380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+43:11426:x1876532858526720:12345-192.168.201.30@tcp:36:dd.0 Request processed in 554us (755us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1789601502.789928:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 154 00000020:00080000:3.0:1789601502.789935:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789601502.791514:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac9dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.791547:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac9dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.791554:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac9dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.791560:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601502.791566:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac9dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.791587:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac9dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.791608:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:2.0:1789601502.791611:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601502.791616:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac9dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601502.791622:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ac9dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.243904:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601503.264003:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601503.264082:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858526848 00000100:00100000:2.0:1789601503.264093:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858526848 00000100:00100000:2.0:1789601503.264191:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 155 00000100:00100000:2.0:1789601503.264203:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+42:11441:x1876532858526848:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:2.0:1789601503.264227:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601503.264250:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac9e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506127a expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.264319:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac9eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.264349:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac9eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.264361:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac9eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.264378:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac9f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.264386:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.264393:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.264481:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac9f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.264493:0:8248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac9cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061273 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.264501:0:8248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac9f9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.264538:0:8248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac9cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061273 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.264555:0:8248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac9cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061273 expref: 43 pid: 5838 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601503.264593:0:8248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880552448:192.168.201.30@tcp:104: 00000100:00080000:1.0:1789601503.264740:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601503.264806:0:8248:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc96046c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601503.270107:0:8248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a58a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880552448:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789601503.270148:0:8248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac9f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601503.274177:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601503.274240:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858527104 00000100:00100000:3.0:1789601503.274251:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858527104 00000100:00100000:3.0:1789601503.274309:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:3.0:1789601503.274320:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+44:5596:x1876532858527104:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789601503.275089:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+45:5596:x1876532858527104:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 769us (919us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1789601503.275099:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:0.0:1789601503.277903:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601503.278158:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858527232 00000100:00100000:1.0:1789601503.278170:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858527232 00010000:00010000:1.0:1789601503.278228:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac9cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061273 expref: 45 pid: 5838 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601503.278273:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:1.0:1789601503.278284:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+45:2356:x1876532858527232:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601503.278300:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601503.278308:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac9cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061273 expref: 45 pid: 5838 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.278322:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac9cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061273 expref: 45 pid: 5838 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.278345:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ac9cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061273 expref: 45 pid: 5838 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.278382:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:1.0:1789601503.278388:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac9f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.278398:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.278405:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac9f9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.278445:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601503.278516:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+44:2356:x1876532858527232:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 233us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601503.278711:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 66 00010000:00010000:2.0:1789601503.279645:0:8248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.279656:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601503.279705:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789601503.279710:0:8248:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789601503.279737:0:8248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.279750:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.279760:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac9eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.279767:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac9eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.279774:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac9eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.279780:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601503.279795:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac9eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.279803:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac9eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.279816:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:2.0:1789601503.279819:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601503.279823:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac9eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.279828:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ac9eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.279865:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac9f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.279872:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac9f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.279878:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.279882:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8cc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601503.279884:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac9f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.279888:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac9f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.279893:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91edd8a67b00) 00010000:00010000:2.0:1789601503.279894:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601503.279904:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac9f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.279908:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ac9f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.279945:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ac9e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506127a expref: 44 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.279959:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac9f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506127a expref: 43 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.279966:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:2.0:1789601503.280025:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601503.280029:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8dc00, rc 0) 00000100:00100000:2.0:1789601503.280078:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+43:11441:x1876532858526848:12345-192.168.201.30@tcp:101:stat.0 Request processed in 15877us (16082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601503.280089:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 155 00000100:00100000:0.0:1789601503.367972:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601503.368087:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858527488 00000100:00100000:3.0:1789601503.368100:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858527488 00000100:00100000:3.0:1789601503.368174:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 156 00000100:00100000:3.0:1789601503.368187:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+43:11447:x1876532858527488:12345-192.168.201.30@tcp:36:truncate.0 00010000:00010000:3.0:1789601503.368263:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601503.368296:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ac9f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506127a expref: 43 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.368321:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:3.0:1789601503.368327:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601503.368735:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158aca00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.368751:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158aca00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.368762:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158aca00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601503.368826:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1789601503.368892:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015419ec4 reply state 00000000f047e29e transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158aca00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601503.368901:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789601503.369789:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+45:11447:x1876532858527488:12345-192.168.201.30@tcp:36:truncate.0 Request processed in 1600us (1824us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1789601503.369798:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 156 00000020:00080000:3.0:1789601503.369805:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789601503.372055:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158aca00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.372073:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158aca00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.373853:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158aca00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.373862:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601503.373867:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158aca00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.373877:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158aca00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.373918:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:1.0:1789601503.373920:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601503.373925:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158aca00 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.373931:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158aca00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601503.609322:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601503.609747:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858527616 00000100:00100000:3.0:1789601503.609760:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858527616 00000100:00100000:3.0:1789601503.609918:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 157 00000100:00100000:3.0:1789601503.609930:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+44:11461:x1876532858527616:12345-192.168.201.30@tcp:101:stat.0 00010000:00010000:3.0:1789601503.609958:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601503.609985:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158aca07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061281 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610055:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158aca0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610071:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158aca0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610083:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158aca0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610099:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158aca15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610135:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158aca15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610143:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158aca15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610252:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158aca1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610261:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158aca1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610268:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158aca1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601503.610310:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1789601503.610315:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789601503.610336:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158aca1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610348:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158aca1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610355:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158aca0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610362:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158aca0e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610369:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158aca0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610385:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601503.610397:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158aca0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610406:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158aca0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610420:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:3.0:1789601503.610422:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601503.610427:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158aca0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610434:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158aca0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610448:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158aca15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610453:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158aca15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610460:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158aca15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610465:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601503.610467:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158aca15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610473:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158aca15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610491:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91edd8ce5600) 00010000:00010000:3.0:1789601503.610494:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601503.610497:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158aca15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610503:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158aca15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610547:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158aca07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061281 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610561:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158aca1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061281 expref: 45 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.610569:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:3.0:1789601503.610572:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601503.610574:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc200, rc 0) 00000100:00100000:3.0:1789601503.610646:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+45:11461:x1876532858527616:12345-192.168.201.30@tcp:101:stat.0 Request processed in 719us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601503.610654:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 157 00000100:00100000:0.0:1789601503.738443:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601503.738547:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858527872 00000100:00100000:2.0:1789601503.738558:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858527872 00000100:00100000:2.0:1789601503.738621:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 158 00000100:00100000:2.0:1789601503.738632:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+45:11471:x1876532858527872:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789601503.738653:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601503.738675:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158aca23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061288 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601503.738777:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789601503.738935:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158aca23 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061288 expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.738968:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8ce5c00) 00010000:00010000:2.0:1789601503.738971:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789601503.738977:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158aca23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061288 expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.738991:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8de00, rc 0) 00000100:00100000:2.0:1789601503.739059:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+46:11471:x1876532858527872:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 428us (626us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1789601503.739066:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 158 00000100:00100000:1.0:1789601503.743716:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601503.743777:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858528128 00000100:00100000:3.0:1789601503.743786:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858528128 00000100:00100000:3.0:1789601503.743832:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:3.0:1789601503.743890:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91eddcdaf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+46:11471:x1876532858528128:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1789601503.744098:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91eddcdaf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+47:11471:x1876532858528128:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 220us (399us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789601503.744114:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:0.0:1789601503.831069:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601503.831147:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858528384 00000100:00100000:1.0:1789601503.831157:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858528384 00000100:00100000:1.0:1789601503.832469:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 159 00000100:00100000:1.0:1789601503.832485:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+47:11477:x1876532858528384:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:1.0:1789601503.832512:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601503.832535:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158aca31 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506128f expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.832647:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158aca38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.832663:0:8248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158aca1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061281 expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.832671:0:8248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158aca38 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.832709:0:8248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158aca1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061281 expref: 48 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.832744:0:8248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158aca1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061281 expref: 48 pid: 5838 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601503.832759:0:8248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf7eddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880552576:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789601503.832896:0:8248:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc539fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789601503.839027:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601503.839097:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858528512 00000100:00100000:3.0:1789601503.839120:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858528512 00010000:00010000:3.0:1789601503.839171:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158aca1c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061281 expref: 49 pid: 5838 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601503.839310:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:3.0:1789601503.839322:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+49:2356:x1876532858528512:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601503.839341:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601503.839349:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158aca1c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061281 expref: 49 pid: 5838 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.839363:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158aca1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061281 expref: 49 pid: 5838 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.839385:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:3.0:1789601503.839391:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158aca38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.839401:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158aca38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.839409:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158aca38 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.839429:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601503.839490:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+49:2356:x1876532858528512:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 171us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601503.839497:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 67 00010000:00010000:1.0:1789601503.841052:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158aca1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061281 expref: 48 pid: 5838 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601503.841079:0:8248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf7eddc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880552576:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601503.841114:0:8248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158aca38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.841125:0:8248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158aca38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.841131:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158aca38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601503.841154:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1789601503.841719:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158aca31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506128f expref: 49 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.841733:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158aca38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506128f expref: 48 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.841739:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:1.0:1789601503.841753:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789601503.841756:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c4a00, rc 0) 00000100:00100000:1.0:1789601503.841817:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+48:11477:x1876532858528384:12345-192.168.201.30@tcp:101:bash.0 Request processed in 9338us (10754us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1789601503.841826:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 159 00000100:00100000:2.0:1789601503.848181:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601503.848364:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858528768 00000100:00100000:3.0:1789601503.848389:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858528768 00000100:00100000:3.0:1789601503.848457:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 160 00000100:00100000:3.0:1789601503.848466:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+48:11477:x1876532858528768:12345-192.168.201.30@tcp:36:bash.0 00010000:00010000:3.0:1789601503.848890:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.848909:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.848921:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601503.848976:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1789601503.849004:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a6c80e9 reply state 000000002bd66655 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601503.849013:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789601503.849111:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+51:11477:x1876532858528768:12345-192.168.201.30@tcp:36:bash.0 Request processed in 635us (938us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1789601503.849119:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 160 00000020:00080000:3.0:1789601503.849125:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789601503.858323:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601503.858731:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858528896 00000100:00100000:3.0:1789601503.858741:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858528896 00000100:00100000:3.0:1789601503.858798:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 161 00000100:00100000:3.0:1789601503.858809:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+51:11477:x1876532858528896:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789601503.858834:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601503.858893:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158aca4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061296 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.858994:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158aca54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.859017:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158aca38 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506128f expref: 52 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.859024:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca46 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.859031:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158aca54 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.859050:0:5838:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.859088:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158aca38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506128f expref: 52 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.859111:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158aca38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506128f expref: 52 pid: 8248 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601503.859124:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf80a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1876532880552704:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789601503.859213:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edcb731f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601503.863054:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf80a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1876532880552704:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601503.863093:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158aca54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.863749:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.863761:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.863769:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.863775:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadca00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601503.863780:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.863787:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.863805:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:2.0:1789601503.863823:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601503.863827:0:3303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158aca54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.863857:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601503.863863:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601503.868226:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601503.869025:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858529024 00000100:00100000:3.0:1789601503.869040:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858529024 00010000:00010000:3.0:1789601503.869087:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158aca38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506128f expref: 52 pid: 8248 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601503.869349:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:1.0:1789601503.869362:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+52:2356:x1876532858529024:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601503.869379:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601503.869388:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158aca38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506128f expref: 52 pid: 8248 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.869911:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158aca38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506128f expref: 52 pid: 8248 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.869939:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158aca38 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506128f expref: 52 pid: 8248 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.869956:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:1.0:1789601503.869963:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158aca54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.869974:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158aca54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.869982:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158aca54 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601503.870031:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601503.870155:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+51:2356:x1876532858529024:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 794us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601503.870163:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00010000:00010000:3.0:1789601503.870252:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158aca54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.870261:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158aca54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601503.870311:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789601503.870317:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789601503.870338:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158aca54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.870370:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158aca4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061296 expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.870387:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158aca54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061296 expref: 50 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601503.870406:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:3.0:1789601503.870409:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601503.870411:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc400, rc 0) 00000100:00100000:3.0:1789601503.870447:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7eddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+50:11477:x1876532858528896:12345-192.168.201.30@tcp:101:bash.0 Request processed in 11640us (12135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601503.870454:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 161 00000100:00100000:2.0:1789601503.887117:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601503.887901:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858529280 00000100:00100000:3.0:1789601503.887915:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858529280 00000100:00100000:3.0:1789601503.887968:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:3.0:1789601503.887977:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+50:11477:x1876532858529280:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:3.0:1789601503.888803:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+51:11477:x1876532858529280:12345-192.168.201.30@tcp:35:bash.0 Request processed in 823us (1703us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1789601503.888812:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:0.0:1789601504.011263:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601504.011401:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858529536 00000100:00100000:3.0:1789601504.011413:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858529536 00000100:00100000:3.0:1789601504.011476:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 162 00000100:00100000:3.0:1789601504.011496:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+51:11487:x1876532858529536:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601504.011525:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601504.011546:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158aca5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506129d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601504.011651:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789601504.011784:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158aca5b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506129d expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.011800:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8ce5c00) 00010000:00010000:3.0:1789601504.011803:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601504.011808:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158aca5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506129d expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.011822:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadce00, rc 0) 00000100:00100000:3.0:1789601504.011939:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+52:11487:x1876532858529536:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 453us (685us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1789601504.011946:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 162 00000100:00100000:1.0:1789601504.014749:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601504.018162:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858529664 00000100:00100000:2.0:1789601504.018269:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858529664 00000100:00100000:2.0:1789601504.018386:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 163 00000100:00100000:2.0:1789601504.018399:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+52:11487:x1876532858529664:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:2.0:1789601504.018492:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158aca69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018519:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158aca69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018535:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158aca69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018552:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aca70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018561:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aca70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018568:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aca70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018696:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158aca77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018705:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158aca77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018712:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158aca77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601504.018757:0:8248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158aca77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018770:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158aca69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018777:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158aca69 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018783:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158aca69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018790:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8de00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601504.018794:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158aca69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018802:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158aca69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018814:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:2.0:1789601504.018832:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601504.018858:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158aca69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018872:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158aca69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018886:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aca70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018893:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aca70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018900:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aca70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018905:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8cc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601504.018908:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aca70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018915:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aca70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018923:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91edd8a67b00) 00010000:00010000:2.0:1789601504.018926:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601504.018929:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aca70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018936:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aca70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018951:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158aca77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018957:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158aca77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018969:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158aca77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018974:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601504.018976:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158aca77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018982:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158aca77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.018991:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:2.0:1789601504.018993:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601504.018996:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158aca77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.019002:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158aca77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601504.019093:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+52:11487:x1876532858529664:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 697us (4352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601504.019111:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 163 00000100:00100000:1.0:1789601504.024133:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601504.024348:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858529920 00000100:00100000:2.0:1789601504.024359:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858529920 00000100:00100000:2.0:1789601504.024416:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:2.0:1789601504.024427:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+52:11487:x1876532858529920:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789601504.024796:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+53:11487:x1876532858529920:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 370us (672us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1789601504.024804:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:0.0:1789601504.079949:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601504.080085:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858530176 00000100:00100000:3.0:1789601504.080096:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858530176 00000100:00100000:3.0:1789601504.080192:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 164 00000100:00100000:3.0:1789601504.080203:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+53:11490:x1876532858530176:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601504.080237:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601504.080260:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158aca7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50612a4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.080330:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158aca85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.080344:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158aca85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.080355:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158aca85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.080370:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.080377:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.080383:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.080776:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158aca93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.080786:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158aca93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.080794:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158aca93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601504.080816:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789601504.081006:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158aca85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.081014:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158aca85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.081022:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158aca85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.081028:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601504.081032:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158aca85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.081040:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158aca85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.081050:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:3.0:1789601504.081053:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601504.081058:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158aca85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.081065:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158aca85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.081077:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.081083:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.081108:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.081114:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadca00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601504.081117:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.081124:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.081132:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91edd8ce5600) 00010000:00010000:3.0:1789601504.081135:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601504.081137:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.081143:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158aca8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.081189:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158aca7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612a4 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.081203:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158aca93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612a4 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.081211:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:3.0:1789601504.081213:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601504.081215:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc200, rc 0) 00000100:00100000:3.0:1789601504.081757:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:11490:x1876532858530176:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1553us (1815us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1789601504.081776:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 164 00000100:00100000:1.0:1789601504.088755:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601504.088804:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601504.088982:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858530432 00000100:00100000:3.0:1789601504.088993:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858530432 00000100:00100000:3.0:1789601504.089055:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 165 00000100:00100000:3.0:1789601504.089065:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc704b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:11490:x1876532858530432:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:3.0:1789601504.089155:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acaa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.089173:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.089186:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.089220:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acaa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.089238:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acaa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.089246:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acaa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.089253:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88c00 already unused, calling callback (ffffffffc221e4f0) 00000100:00100000:2.0:1789601504.089258:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858530304 00010000:00010000:3.0:1789601504.089259:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acaa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601504.089266:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858530304 00010000:00010000:3.0:1789601504.089271:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acaa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.089285:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:3.0:1789601504.089303:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:2.0:1789601504.089309:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00010000:00010000:3.0:1789601504.089310:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acaa1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.089320:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acaa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601504.089322:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+56:2357:x1876532858530304:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601504.089343:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601504.089362:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158aca93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612a4 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.089377:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:2.0:1789601504.089381:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601504.089404:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc704b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:11490:x1876532858530432:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 339us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601504.089410:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:2357:x1876532858530304:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 88us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601504.089415:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 165 00000100:00100000:2.0:1789601504.089724:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:1.0:1789601504.093830:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601504.094616:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858530688 00000100:00100000:2.0:1789601504.094630:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858530688 00000100:00100000:2.0:1789601504.094695:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:2.0:1789601504.094705:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc704aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+54:11490:x1876532858530688:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789601504.094981:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc704aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:11490:x1876532858530688:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 276us (1173us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789601504.094990:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:3.0:1789601504.201331:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf80a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880553216:0@lo:400:kworker.0 00000100:00100000:0.0:1789601504.201554:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf80a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880553088:0@lo:400:kworker.0 00000100:00100000:0.0:1789601504.201594:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601504.201696:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880553088 00000100:00100000:0.0:1789601504.201704:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880553088 00000100:00100000:0.0:1789601504.201760:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789601504.201770:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880553088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601504.201821:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880553088:12345-0@lo:400:kworker.0 Request processed in 53us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601504.201828:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:0.0:1789601504.201873:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601504.201901:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf80a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880553088:0@lo:400:kworker.0 00000100:00100000:2.0:1789601504.202077:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf80a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880552960:0@lo:400:kworker.0 00000100:00100000:2.0:1789601504.202121:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601504.202155:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc8310700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880553472:0@lo:400:kworker.0 00000100:00100000:2.0:1789601504.202179:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601504.202215:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789601504.202222:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf80a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880552832:0@lo:400:kworker.0 00000100:00100000:2.0:1789601504.202271:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601504.202293:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf80a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880553344:0@lo:400:kworker.0 00000100:00100000:2.0:1789601504.202313:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601504.202340:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880553472 00000100:00100000:2.0:1789601504.202344:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880553472 00000100:00100000:2.0:1789601504.202381:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789601504.202388:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880553472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601504.202441:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880553472:12345-0@lo:400:kworker.0 Request processed in 53us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601504.202447:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789601504.202465:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880552832 00000100:00100000:2.0:1789601504.202469:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880552832 00000100:00100000:2.0:1789601504.202491:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789601504.202498:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880552832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601504.202543:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880552832:12345-0@lo:400:kworker.0 Request processed in 45us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601504.202549:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:2.0:1789601504.202574:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601504.202591:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf80a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880552832:0@lo:400:kworker.0 00000100:00100000:2.0:1789601504.202602:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc8310700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880553472:0@lo:400:kworker.0 00000100:00100000:3.0:1789601504.203250:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601504.203410:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880552960 00000100:00100000:0.0:1789601504.203416:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880552960 00000100:00100000:0.0:1789601504.203456:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880553344 00000100:00100000:0.0:1789601504.203459:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880553344 00000100:00100000:0.0:1789601504.203487:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789601504.203494:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880552960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601504.203543:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880552960:12345-0@lo:400:kworker.0 Request processed in 50us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601504.203561:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789601504.203576:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789601504.203582:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880553344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601504.203820:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880553344:12345-0@lo:400:kworker.0 Request processed in 237us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601504.203827:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789601504.204383:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880553216 00000100:00100000:2.0:1789601504.204404:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880553216 00000100:00100000:2.0:1789601504.204448:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789601504.204456:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8310700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1876532880553216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601504.204516:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8310700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1876532880553216:12345-0@lo:400:kworker.0 Request processed in 61us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601504.204532:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1789601504.204551:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789601504.204555:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601504.204589:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf80a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880553344:0@lo:400:kworker.0 00000100:00100000:2.0:1789601504.204601:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf80a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880552960:0@lo:400:kworker.0 00000100:00100000:1.0:1789601504.204961:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf80a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880553216:0@lo:400:kworker.0 00010000:00010000:0.0:1789601504.268757:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601504.320569:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601504.320632:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858530944 00000100:00100000:3.0:1789601504.320645:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858530944 00000100:00100000:3.0:1789601504.320725:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 166 00000100:00100000:3.0:1789601504.320736:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:11508:x1876532858530944:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:3.0:1789601504.320764:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601504.320789:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acaa8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50612ab expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.320919:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acaaf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.320936:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acaaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.320947:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acaaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601504.320958:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789601504.321139:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acaa8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ab expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.321160:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acaaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ab expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.321177:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:3.0:1789601504.321179:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789601504.321183:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b89e00, rc 0) 00000100:00100000:3.0:1789601504.321332:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+57:11508:x1876532858530944:12345-192.168.201.30@tcp:101:cat.0 Request processed in 596us (771us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1789601504.321340:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 166 00000100:00100000:1.0:1789601504.380232:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601504.380309:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858531072 00000100:00100000:3.0:1789601504.380320:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858531072 00000100:00100000:3.0:1789601504.380383:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 167 00000100:00100000:3.0:1789601504.380403:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc7048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+57:11509:x1876532858531072:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601504.380427:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601504.380449:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acabd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50612b2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.380516:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acac4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.380532:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.380544:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601504.380599:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789601504.380616:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789601504.380647:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.380675:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acabd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612b2 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.380695:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acac4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612b2 expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.380715:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:3.0:1789601504.380718:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601504.380722:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88600, rc 0) 00000100:00100000:3.0:1789601504.380785:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc7048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+58:11509:x1876532858531072:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 393us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601504.380792:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 167 00000100:00100000:1.0:1789601504.393621:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601504.394376:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858531456 00000100:00100000:3.0:1789601504.394387:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858531456 00000100:00100000:3.0:1789601504.394467:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:3.0:1789601504.394479:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc7048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+58:11509:x1876532858531456:12345-192.168.201.30@tcp:35:lfs.0 00000001:00080000:3.0:1789601504.394791:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967456 00000100:00100000:3.0:1789601504.394954:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc7048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+60:11509:x1876532858531456:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 478us (1345us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1789601504.394962:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 48 00000020:00080000:3.0:1789601504.394967:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789601504.404510:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601504.404867:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858531584 00000100:00100000:3.0:1789601504.404878:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858531584 00000100:00100000:3.0:1789601504.404946:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:3.0:1789601504.404956:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+60:11509:x1876532858531584:12345-192.168.201.30@tcp:103:lfs.0 00010000:00010000:3.0:1789601504.404971:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789601504.404994:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158aca54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061296 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.405019:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acaaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ab expref: 59 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.405031:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ac95f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061257 expref: 58 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601504.405041:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8ce5a00) 00010000:00010000:3.0:1789601504.405055:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601504.405129:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+57:11509:x1876532858531584:12345-192.168.201.30@tcp:103:lfs.0 Request processed in 175us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601504.405136:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:1.0:1789601504.407922:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601504.408025:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858531712 00000100:00100000:0.0:1789601504.408038:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858531712 00000100:00100000:0.0:1789601504.408109:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 168 00000100:00100000:0.0:1789601504.408120:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc704a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+57:11509:x1876532858531712:12345-192.168.201.30@tcp:58:lfs.0 00010000:00010000:0.0:1789601504.408261:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158acacb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601504.408279:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158acacb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601504.408291:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158acacb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789601504.408492:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1789601504.408599:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc704a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+57:11509:x1876532858531712:12345-192.168.201.30@tcp:58:lfs.0 Request processed in 480us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601504.408607:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 168 00000100:00100000:1.0:1789601504.460924:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601504.461565:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858531840 00000100:00100000:2.0:1789601504.461576:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858531840 00000100:00100000:2.0:1789601504.461654:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 169 00000100:00100000:2.0:1789601504.461665:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc7048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+57:11511:x1876532858531840:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789601504.461687:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601504.461707:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acad2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50612b9 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.461771:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158acad9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.461785:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158acad9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.461797:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158acad9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.461812:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158acae0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.461820:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158acae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.461826:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158acae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.461940:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acae7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.461946:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acae7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.461951:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acae7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601504.461982:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789601504.461985:0:8248:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789601504.462002:0:8248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acae7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.462011:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acae7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.462017:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158acad9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.462022:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158acad9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.462026:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158acad9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.462029:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8de00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601504.462032:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158acad9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.462037:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158acad9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.462052:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:2.0:1789601504.462054:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601504.462057:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158acad9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.462061:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158acad9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.462072:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158acae0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.462075:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158acae0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.462078:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158acae0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.462082:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601504.462084:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158acae0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.462087:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158acae0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.462102:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91edd8a67b00) 00010000:00010000:2.0:1789601504.462105:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601504.462107:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158acae0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.462113:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158acae0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.462161:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acad2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612b9 expref: 59 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.462175:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acae7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612b9 expref: 58 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.462181:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd0646400) 00010000:00010000:2.0:1789601504.462183:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789601504.462450:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8d400, rc 0) 00000100:00100000:2.0:1789601504.463434:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc7048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+58:11511:x1876532858531840:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1764us (2513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601504.463444:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 169 00000100:00100000:0.0:1789601504.715256:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf80a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880553600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601504.715375:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601504.715447:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880553600 00000100:00100000:0.0:1789601504.715455:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880553600 00000100:00100000:0.0:1789601504.715500:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789601504.715509:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880553600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789601504.715543:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789601504.715588:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880553600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601504.715596:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789601504.715645:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf80a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880553600:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1789601504.829854:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967420 is committed 00000001:00080000:2.0:1789601504.829885:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967447 is committed 00000001:00080000:2.0:1789601504.829903:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000001:00080000:2.0:1789601504.829939:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000004:00080000:2.0:1789601504.829973:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789601504.829992:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91edc90fcd80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789601504.829996:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91edf7ed6400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91edc90fc9c0 00000020:00080000:2.0:1789601504.830000:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91edf7ed6d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91edf8500c00 00000020:00080000:2.0:1789601504.830182:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1789601504.830331:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789601504.830347:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880553728:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789601504.830401:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601504.830478:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880553728 00000100:00100000:2.0:1789601504.830501:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880553728 00000100:00100000:2.0:1789601504.830547:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789601504.830556:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1876532880553728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789601504.830583:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1789601504.830615:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aab26de, atime: 0x6aab26df, ctime: 0x6aab26de, blocks: 0x1 00010000:00010000:2.0:1789601504.830624:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015968b07/0xf3d6e402158acaee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.830641:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=374s v=(0 0) 00010000:00010000:2.0:1789601504.830646:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601504.830653:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015968b07/0xf3d6e402158acaee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.830669:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015968b07/0xf3d6e402158acaee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.830680:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015968b07/0xf3d6e402158acaee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.830686:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015968b07/0xf3d6e402158acaee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.830700:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789601504.831077:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3318:x1876532880553728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 522us (674us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789601504.831082:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1789601504.831121:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601504.831137:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015968b07/0xf3d6e402158acaee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.831145:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d000 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601504.831150:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015968b07/0xf3d6e402158acaee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.831158:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015968b07/0xf3d6e402158acaee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.831173:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015968b07/0xf3d6e402158acaee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.831180:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015968b07/0xf3d6e402158acaee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601504.831198:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601504.831201:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601504.831202:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789601504.831236:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91edffa5a300/2, rc 0, transno 4294967307 00000100:00100000:2.0:1789601504.831241:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880553728:0@lo:6:osp-syn-0-0.0 00000040:00080000:1.0:1789601505.040016:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601505.040027:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601505.040075:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789601505.040092:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789601505.040287:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edefec2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1876532880553856:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789601505.040455:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc50bbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601505.046263:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edefec2680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1876532880553856:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789601505.058276:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601505.058523:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858531968 00000100:00100000:3.0:1789601505.058535:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858531968 00000100:00100000:3.0:1789601505.058619:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 170 00000100:00100000:3.0:1789601505.058630:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+16:11522:x1876532858531968:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789601505.058665:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789601505.058766:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+16:11522:x1876532858531968:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 137us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601505.058786:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 170 00000100:00080000:0.0:1789601505.058868:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601505.074232:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601505.074346:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858532096 00000100:00100000:3.0:1789601505.074357:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858532096 00000100:00100000:3.0:1789601505.074415:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 171 00000100:00100000:3.0:1789601505.074426:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+16:11522:x1876532858532096:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789601505.074501:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acaf5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074517:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acaf5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074532:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acaf5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074596:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acafc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074604:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acafc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074611:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acafc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074640:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074649:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074655:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601505.074699:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789601505.074703:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789601505.074716:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074726:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acaf5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074733:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acaf5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074740:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acaf5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074747:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601505.074752:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acaf5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074760:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acaf5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074773:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91edd35e8700) 00010000:00010000:3.0:1789601505.074776:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601505.074782:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acaf5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074789:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acaf5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074800:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acafc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074828:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acafc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074859:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acafc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074865:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601505.074868:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acafc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074875:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acafc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074882:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff91edd8ce5600) 00010000:00010000:3.0:1789601505.074885:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601505.074887:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acafc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074893:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acafc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074909:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074914:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074920:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074924:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601505.074933:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074939:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074946:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd0646400) 00010000:00010000:3.0:1789601505.074949:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601505.074951:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.074958:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601505.075031:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefec2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+16:11522:x1876532858532096:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 Request processed in 606us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601505.075039:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 171 00000100:00100000:0.0:1789601505.085103:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601505.085231:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858532352 00000100:00100000:3.0:1789601505.085242:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858532352 00000100:00100000:3.0:1789601505.085301:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 172 00000100:00100000:3.0:1789601505.085311:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+16:11522:x1876532858532352:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789601505.085332:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601505.085352:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb0a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50612c0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.085464:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.085481:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.085509:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601505.085522:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789601505.085715:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.085724:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.085731:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.085738:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601505.085742:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.085749:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.085762:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd0646400) 00010000:00010000:3.0:1789601505.085765:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601505.085770:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.085776:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.085817:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb0a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612c0 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.085879:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91edd35e8700) 00010000:00010000:3.0:1789601505.085882:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601505.085888:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb0a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612c0 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.085898:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88c00, rc 0) 00000100:00100000:3.0:1789601505.085963:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+17:11522:x1876532858532352:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 653us (880us total) trans 4294967458 rc 301/301 00000100:00100000:3.0:1789601505.085971:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 172 00000100:00100000:1.0:1789601505.090132:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601505.090272:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858532480 00000100:00100000:3.0:1789601505.090283:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858532480 00000100:00100000:3.0:1789601505.090349:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 173 00000100:00100000:3.0:1789601505.090359:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+17:11522:x1876532858532480:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789601505.090400:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789601505.090501:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+17:11522:x1876532858532480:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 144us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601505.090508:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 173 00000100:00100000:2.0:1789601505.103348:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601505.103427:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858532736 00000100:00100000:3.0:1789601505.103436:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858532736 00000100:00100000:3.0:1789601505.103491:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 174 00000100:00100000:3.0:1789601505.103502:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+17:11522:x1876532858532736:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789601505.103525:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601505.103528:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789601505.103554:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acac4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612b2 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.103589:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:3.0:1789601505.103594:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601505.103609:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb1f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50612c7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789601505.104758:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1789601505.105002:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158acb26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.105015:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158acb26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.105023:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158acb26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.105068:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb1f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612c7 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.105095:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158acb26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612c7 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.105116:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91edd0646d00) 00010000:00010000:0.0:1789601505.105119:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789601505.105122:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924000, rc 0) 00000100:00100000:0.0:1789601505.105191:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:11522:x1876532858532736:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 1691us (1853us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1789601505.105199:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 174 00000100:00100000:0.0:1789601505.117811:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601505.118340:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858532992 00000100:00100000:3.0:1789601505.118351:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858532992 00000100:00100000:3.0:1789601505.118455:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 175 00000100:00100000:3.0:1789601505.118466:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:11522:x1876532858532992:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789601505.118526:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601505.118554:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158acb26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612c7 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.118578:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91edd0646d00) 00010000:00010000:3.0:1789601505.118593:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601505.118616:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.118631:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.118640:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.118654:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x6ab731e3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.118660:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ab731e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.118682:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ab731e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.118933:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.118940:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.118946:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.118952:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601505.118956:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.118963:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.118972:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:3.0:1789601505.118975:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601505.118978:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb34 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.118984:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.118994:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ab731e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.119000:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ab731e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.119011:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ab731e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.119016:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601505.119020:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ab731e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.119026:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x6ab731e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.119034:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x6ab731e3 (ffff91edd8ce5600) 00010000:00010000:3.0:1789601505.119036:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601505.119039:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6ab731e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.119045:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x6ab731e3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601505.119161:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+17:11522:x1876532858532992:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 688us (1353us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789601505.119169:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 175 00000100:00100000:1.0:1789601505.134579:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601505.134650:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858533120 00000100:00100000:0.0:1789601505.134660:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858533120 00000100:00100000:0.0:1789601505.134712:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 176 00000100:00100000:0.0:1789601505.134732:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+17:11522:x1876532858533120:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601505.134754:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601505.134775:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158acb42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50612ce expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.134809:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158acb49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.134824:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158acb49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.134862:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158acb49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.134965:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158acb42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ce expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.134995:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158acb49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ce expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.135003:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91edd0646000) 00010000:00010000:0.0:1789601505.135006:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789601505.135011:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924600, rc 0) 00000100:00100000:0.0:1789601505.135071:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:11522:x1876532858533120:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 351us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601505.135087:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 176 00000100:00100000:0.0:1789601505.143531:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601505.149065:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858533376 00000100:00100000:1.0:1789601505.149091:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858533376 00000100:00100000:1.0:1789601505.149169:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 177 00000100:00100000:1.0:1789601505.149180:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:11522:x1876532858533376:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789601505.149267:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acb50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.149289:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acb50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.149302:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acb50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789601505.149576:0:8248:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1789601505.149585:0:8248:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375187747851ns, next at 376187745869ns, rc = 0 00000004:00010000:1.0:1789601505.149663:0:8248:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091002e96 reply state 000000008eef985e transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acb50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601505.149677:0:8248:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789601505.149784:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:11522:x1876532858533376:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 605us (6263us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1789601505.149791:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 177 00010000:00010000:1.0:1789601505.154127:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acb50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.154146:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acb50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.154154:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acb50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.154161:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601505.154166:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acb50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.154186:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acb50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.154203:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91edd0646000) 00010000:00010000:1.0:1789601505.154206:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789601505.154211:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acb50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.154217:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acb50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601505.157927:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601505.158031:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858533504 00000100:00100000:3.0:1789601505.158042:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858533504 00000100:00100000:3.0:1789601505.158112:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 178 00000100:00100000:3.0:1789601505.158123:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:11522:x1876532858533504:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789601505.158153:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601505.158177:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50612d5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.158269:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612d5 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.158284:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612d5 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.158303:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91edd0646000) 00010000:00010000:3.0:1789601505.158307:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789601505.158312:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b89e00, rc 0) 00000100:00100000:3.0:1789601505.158381:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:11522:x1876532858533504:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 259us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601505.158388:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 178 00000100:00100000:3.0:1789601505.162172:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601505.162372:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858533632 00000100:00100000:0.0:1789601505.162384:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858533632 00000100:00100000:0.0:1789601505.162454:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:0.0:1789601505.162464:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9daa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858533632:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789601505.162810:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9daa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2356:x1876532858533632:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 346us (656us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789601505.162819:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00080000:1.0:1789601505.162914:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601505.168341:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601505.168393:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858533888 00000100:00100000:1.0:1789601505.168404:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858533888 00000100:00100000:1.0:1789601505.168455:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:1.0:1789601505.168464:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:11522:x1876532858533888:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789601505.168706:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:11522:x1876532858533888:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 243us (375us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789601505.168715:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:3.0:1789601505.189905:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601505.196688:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858534144 00000100:00100000:1.0:1789601505.196706:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858534144 00000100:00100000:1.0:1789601505.196871:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 179 00000100:00100000:1.0:1789601505.196885:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:11522:x1876532858534144:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789601505.197010:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:11522:x1876532858534144:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 129us (7114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601505.197032:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 179 00000100:00100000:3.0:1789601505.201385:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601505.203142:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858534272 00000100:00100000:0.0:1789601505.203160:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858534272 00000100:00100000:0.0:1789601505.203241:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 180 00000100:00100000:0.0:1789601505.203252:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:11522:x1876532858534272:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601505.203274:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601505.203296:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158acb5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50612dc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.203382:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acb65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.203399:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acb65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.203412:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acb65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601505.203452:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789601505.203471:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acb65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.203496:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158acb5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612dc expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.203511:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acb65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612dc expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.203519:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91edd0646000) 00010000:00010000:0.0:1789601505.203522:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789601505.203525:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924800, rc 0) 00000100:00100000:0.0:1789601505.203591:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:11522:x1876532858534272:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 341us (2216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601505.203597:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 180 00000100:00100000:2.0:1789601505.209419:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601505.209491:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858534400 00000100:00100000:3.0:1789601505.209501:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858534400 00000100:00100000:3.0:1789601505.209556:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:3.0:1789601505.209567:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2357:x1876532858534400:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789601505.209586:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601505.209606:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158acb6c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50612e3 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789601505.209635:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab26e2, blocks: 0x1 00010000:00010000:3.0:1789601505.209654:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=375s v=(0 0) 00010000:00010000:3.0:1789601505.209667:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601505.209677:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158acb6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612e3 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.209701:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158acb6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612e3 expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.209717:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b89000, rc 0) 00000100:00100000:3.0:1789601505.209777:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2357:x1876532858534400:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 211us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601505.209872:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:0.0:1789601505.220334:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601505.224147:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858534656 00000100:00100000:2.0:1789601505.224165:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858534656 00000100:00100000:2.0:1789601505.224235:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 181 00000100:00100000:2.0:1789601505.224246:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:11522:x1876532858534656:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789601505.224450:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8dea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:11522:x1876532858534656:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 206us (4125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601505.224459:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 181 00000100:00100000:1.0:1789601505.242555:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601505.242811:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858534784 00000100:00100000:3.0:1789601505.242832:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858534784 00000100:00100000:3.0:1789601505.243304:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:3.0:1789601505.243315:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:11522:x1876532858534784:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789601505.243334:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601505.243353:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a108ba75/0xf3d6e402158acb73 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50612ea expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.243446:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158acb6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612e3 expref: 9 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.243457:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601505.243461:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601505.243466:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a108ba75/0xf3d6e402158acb73 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ea expref: 9 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.243510:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158acb6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612e3 expref: 9 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.243524:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158acb6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612e3 expref: 9 pid: 6679 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601505.243539:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00420700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1876532880553984:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789601505.243632:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64000 going to sleep for 11 seconds 00000100:00100000:1.0:1789601505.252045:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601505.252092:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858534912 00000100:00100000:1.0:1789601505.252100:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858534912 00010000:00010000:1.0:1789601505.252140:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158acb6c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612e3 expref: 10 pid: 6679 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601505.252429:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:1.0:1789601505.252441:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede51e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+10:2356:x1876532858534912:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601505.252455:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601505.252480:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158acb6c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612e3 expref: 10 pid: 6679 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.252494:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158acb6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612e3 expref: 10 pid: 6679 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.252520:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601505.252525:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601505.252534:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a108ba75/0xf3d6e402158acb73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ea expref: 10 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.252545:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a108ba75/0xf3d6e402158acb73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ea expref: 10 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.252599:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a108ba75/0xf3d6e402158acb73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ea expref: 10 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601505.252614:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edfff66d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5823:1876532880554112:192.168.201.30@tcp:105: 00000100:00100000:1.0:1789601505.252693:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7ed4240 going to sleep for 11 seconds 00010000:00010000:3.0:1789601505.252808:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d714da1/0xf3d6e402158acb6c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612e3 expref: 10 pid: 6679 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601505.252855:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00420700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1876532880553984:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601505.252879:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a108ba75/0xf3d6e402158acb73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ea expref: 9 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.252889:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88600, rc 0) 00000100:00100000:3.0:1789601505.254750:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8a0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:11522:x1876532858534784:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 11424us (12190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601505.254763:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:3.0:1789601505.266357:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601505.266412:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edfff66d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5823:1876532880554112:192.168.201.30@tcp:105: 00010000:00010000:3.0:1789601505.266436:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601505.266489:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede51e1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2356:x1876532858534912:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 14051us (14454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601505.266506:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:2.0:1789601505.267645:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858535040 00000100:00100000:2.0:1789601505.267656:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858535040 00002000:00100000:2.0:1789601505.267714:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff91ee00420700 x1876532858535040/t0(0) o4->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:101/0 lens 504/0 e 0 to 0 dl 1789601516 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789601505.267727:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91ee00420700 with x1876532858535040 ext(0->8) 00002000:00010000:2.0:1789601505.267732:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91ee00420700 00000100:00100000:2.0:1789601505.267800:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:2.0:1789601505.267808:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2357:x1876532858535040:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789601505.268481:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+10:2357:x1876532858535040:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 Request processed in 669us (2131us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789601505.268490:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00002000:00100000:2.0:1789601505.268498:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff91ee00420700 x1876532858535040/t4294967314(0) o4->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:101/0 lens 504/448 e 0 to 0 dl 1789601516 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789601505.268507:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91ee00420700 with x1876532858535040 ext(0->8) 00002000:00010000:2.0:1789601505.268511:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91ee00420700 00000100:00100000:3.0:1789601505.277530:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601505.277567:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858535168 00000100:00100000:3.0:1789601505.277579:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858535168 00000100:00100000:3.0:1789601505.277632:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 182 00000100:00100000:3.0:1789601505.277642:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:11522:x1876532858535168:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1789601505.291010:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789601505.293491:0:12491:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789601505.293502:0:12491:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789601505.293558:0:12491:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789601505.293565:0:12491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1789601505.303248:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1789601505.333914:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000001:00080000:2.0:1789601505.333934:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:2.0:1789601505.333940:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:2.0:1789601505.333952:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1789601505.333974:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1789601505.333984:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789601505.334036:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:11522:x1876532858535168:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 Request processed in 56389us (56509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601505.334047:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 182 00000100:00100000:1.0:1789601505.334599:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880554240:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789601505.334656:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601505.334691:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880554240 00000100:00100000:2.0:1789601505.334707:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880554240 00000100:00100000:2.0:1789601505.334750:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789601505.334760:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880554240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789601505.334996:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789601505.334999:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789601506 00002000:00010000:2.0:1789601505.335001:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789601505.335002:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789601506 -> 1789601506 00002000:00010000:2.0:1789601505.335004:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789601505.335040:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1876532880554240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 282us (384us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789601505.335047:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1789601505.335280:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91edf8680e00/2, rc 0, transno 4294967315 00000100:00100000:1.0:1789601505.335289:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880554240:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789601505.338666:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601505.338968:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858535296 00000100:00100000:3.0:1789601505.338979:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858535296 00000100:00100000:3.0:1789601505.339064:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:3.0:1789601505.339074:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:2356:x1876532858535296:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789601505.414054:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:0.0:1789601505.414086:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1789601505.415602:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2356:x1876532858535296:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 Request processed in 76516us (76931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601505.415615:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:2.0:1789601505.428800:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601505.434629:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858535552 00000100:00100000:3.0:1789601505.434646:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858535552 00000100:00100000:3.0:1789601505.434722:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 183 00000100:00100000:3.0:1789601505.434733:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:11522:x1876532858535552:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789601505.434789:0:8248:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601505.434826:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acb65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612dc expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.434860:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91edd0646000) 00010000:00010000:3.0:1789601505.434865:0:8248:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601505.434896:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.434921:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.434931:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601505.435890:0:8248:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056fc6290 reply state 00000000833f4829 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601505.435907:0:8248:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789601505.436021:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:11522:x1876532858535552:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 1289us (7229us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1789601505.436030:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 183 00010000:00010000:3.0:1789601505.439236:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.439254:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.439262:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.439268:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601505.439274:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.439282:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.439300:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91edd0646000) 00010000:00010000:3.0:1789601505.439311:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601505.439328:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.439335:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601505.441732:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601505.441805:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858535680 00000100:00100000:1.0:1789601505.441825:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858535680 00000100:00100000:1.0:1789601505.442027:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:1.0:1789601505.442039:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2358:x1876532858535680:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789601505.443608:0:11670:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789601505.443617:0:11670:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789601506 -> 1789601505 00002000:00010000:1.0:1789601505.443620:0:11670:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789601503 00002000:00010000:1.0:1789601505.443622:0:11670:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789601506 -> 1789601505 00002000:00010000:1.0:1789601505.443624:0:11670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789601505.443717:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2358:x1876532858535680:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 1675us (1991us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789601505.443734:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:1.0:1789601505.453991:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601505.455041:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858535936 00000100:00100000:3.0:1789601505.455054:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858535936 00000100:00100000:3.0:1789601505.455238:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 184 00000100:00100000:3.0:1789601505.455250:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:11522:x1876532858535936:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789601505.455332:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acb81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.455351:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158acb49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ce expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.455361:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acb81 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.455403:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158acb49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ce expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.455417:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158acb49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ce expref: 18 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601505.455431:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1876532880554368:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789601505.455622:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789601505.466007:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1876532880554368:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789601505.466039:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acb81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601505.468014:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601505.468051:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858536064 00000100:00100000:2.0:1789601505.468060:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858536064 00010000:00010000:2.0:1789601505.468117:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158acb49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ce expref: 19 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601505.468156:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:2.0:1789601505.468167:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:2356:x1876532858536064:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601505.468184:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601505.468204:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158acb49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ce expref: 19 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601505.468218:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158acb49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ce expref: 19 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601505.468239:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924600/0xf3d6e402158acb49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ce expref: 19 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601505.468253:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91edd0646000) 00010000:00010000:2.0:1789601505.468258:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acb81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601505.468267:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acb81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601505.468274:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acb81 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601505.468300:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601505.468421:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:2356:x1876532858536064:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 255us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601505.468429:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 70 00010000:00010000:2.0:1789601505.468607:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acb81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601505.468615:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acb81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601505.468647:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acb81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601505.468660:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acb81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601505.468666:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acb81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601505.468673:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601505.468677:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acb81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601505.468686:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acb81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601505.468694:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91edd0646000) 00010000:00010000:2.0:1789601505.468697:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789601505.468701:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acb81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601505.468706:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acb81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601505.468752:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+17:11522:x1876532858535936:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 Request processed in 13504us (14768us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789601505.468761:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 184 00000100:00100000:2.0:1789601505.475065:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601505.475116:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858536192 00000100:00100000:2.0:1789601505.475126:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858536192 00000100:00100000:2.0:1789601505.475175:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:2.0:1789601505.475184:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2359:x1876532858536192:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789601505.475243:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158acb88 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601505.475267:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a108ba75/0xf3d6e402158acb73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ea expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601505.475276:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601505.475280:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789601505.475286:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158acb88 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601505.476058:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a108ba75/0xf3d6e402158acb73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ea expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601505.476108:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a108ba75/0xf3d6e402158acb73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ea expref: 8 pid: 6677 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601505.476125:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1876532880554496:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789601505.476249:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8fbfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601505.489870:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601505.490129:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858536320 00000100:00100000:3.0:1789601505.490148:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858536320 00010000:00010000:3.0:1789601505.490188:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a108ba75/0xf3d6e402158acb73 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ea expref: 9 pid: 6677 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601505.490245:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:3.0:1789601505.490255:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:2356:x1876532858536320:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601505.490271:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601505.490294:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a108ba75/0xf3d6e402158acb73 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ea expref: 9 pid: 6677 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.490309:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a108ba75/0xf3d6e402158acb73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ea expref: 9 pid: 6677 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.490486:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789601505.490490:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789601505.490507:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158acb88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.490519:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158acb88 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.490541:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601505.490605:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:2356:x1876532858536320:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 351us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601505.490614:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 71 00010000:00010000:0.0:1789601505.493266:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a108ba75/0xf3d6e402158acb73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ea expref: 8 pid: 6677 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601505.493293:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1876532880554496:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789601505.493332:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158acb88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.496850:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158acb88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.496870:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158acb88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.496912:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158acb88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.496921:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158acb88 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.496930:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158acb88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.496952:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c400 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601505.496957:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158acb88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.496966:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158acb88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.496987:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158acb88 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601505.496995:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158acb88 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601505.497110:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2359:x1876532858536192:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 Request processed in 21922us (22051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601505.497122:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:2.0:1789601505.513742:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601505.514017:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858536576 00000100:00100000:3.0:1789601505.514029:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858536576 00000100:00100000:3.0:1789601505.514151:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 185 00000100:00100000:3.0:1789601505.514162:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+17:11522:x1876532858536576:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789601505.514253:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.514272:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.514287:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.514620:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb96 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.514633:0:8248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb57 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612d5 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.514643:0:8248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb96 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.514684:0:8248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612d5 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.514701:0:8248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb57 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612d5 expref: 18 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601505.514717:0:8248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880554624:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789601505.514920:0:8248:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601505.520343:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601505.520412:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858536704 00000100:00100000:1.0:1789601505.520422:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858536704 00010000:00010000:1.0:1789601505.520464:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb57 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612d5 expref: 19 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601505.520516:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:1.0:1789601505.520525:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:2356:x1876532858536704:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601505.520541:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601505.520548:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb57 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612d5 expref: 19 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.520561:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb57 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612d5 expref: 19 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.520584:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91edd0646000) 00010000:00010000:1.0:1789601505.520589:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb96 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.520598:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.520606:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb96 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.520625:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601505.520682:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:2356:x1876532858536704:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 158us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601505.520702:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 72 00010000:00010000:3.0:1789601505.520808:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acb57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612d5 expref: 18 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601505.520864:0:8248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880554624:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601505.520885:0:8248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.520894:0:8248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.520900:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601505.521099:0:8248:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1789601505.521255:0:8248:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1789601505.521301:0:8248:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1789601505.521385:0:8248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8248:1876532880554752:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789601505.521452:0:8248:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601505.521488:0:8248:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64180 going to sleep for 11 seconds 00000100:00100000:1.0:1789601505.521612:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880554752 00000100:00100000:1.0:1789601505.521618:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880554752 00000100:00100000:1.0:1789601505.521665:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789601505.521674:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8248:x1876532880554752:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789601505.521750:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8248:x1876532880554752:12345-0@lo:1000:mdt00_003.0 Request processed in 78us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601505.521756:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789601505.522276:0:8248:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1789601505.522281:0:8248:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91edf8680e00, transno 4294967315 00000100:00100000:3.0:1789601505.522292:0:8248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8248:1876532880554752:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789601505.522753:0:8248:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1789601505.522825:0:8248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8248:1876532880554880:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789601505.523688:0:8248:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601505.523759:0:8248:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601505.523796:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880554880 00000100:00100000:0.0:1789601505.523803:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880554880 00000100:00100000:0.0:1789601505.524097:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789601505.524109:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8248:x1876532880554880:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789601505.524324:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8248:x1876532880554880:12345-0@lo:1000:mdt00_003.0 Request processed in 208us (629us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789601505.524332:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789601505.524402:0:8248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c69c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8248:1876532880554880:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789601505.524443:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.524455:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb96 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.524462:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb96 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.524468:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601505.524473:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb96 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.524482:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb96 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.524507:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91edd0646000) 00010000:00010000:1.0:1789601505.524510:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789601505.524527:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb96 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.524533:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acb96 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.524567:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158acacb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.524573:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158acacb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.524579:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158acacb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.524583:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925400 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601505.524586:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158acacb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.524591:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158acacb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.524598:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd0646400) 00010000:00010000:1.0:1789601505.524601:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789601505.524603:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158acacb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.524609:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158acacb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.524628:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acb9d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.524642:0:8248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acae7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612b9 expref: 21 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.524656:0:8248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acb9d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.524688:0:8248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acae7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612b9 expref: 21 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.524702:0:8248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acae7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612b9 expref: 21 pid: 8248 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601505.524716:0:8248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee008d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880555008:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789601505.524793:0:8248:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7ed4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601505.534740:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601505.534865:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858536832 00000100:00100000:3.0:1789601505.534875:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858536832 00010000:00010000:3.0:1789601505.534921:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acae7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612b9 expref: 22 pid: 8248 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601505.534963:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:3.0:1789601505.534985:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:2357:x1876532858536832:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601505.535001:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601505.535008:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acae7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612b9 expref: 22 pid: 8248 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.535028:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acae7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612b9 expref: 22 pid: 8248 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.535050:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd0646400) 00010000:00010000:3.0:1789601505.535055:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acb9d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.535066:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acb9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.535089:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acb9d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.535111:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601505.535165:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:2357:x1876532858536832:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 181us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601505.535173:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 73 00010000:00010000:1.0:1789601505.539205:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acae7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612b9 expref: 21 pid: 8248 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601505.539235:0:8248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee008d7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880555008:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601505.539260:0:8248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acb9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.539271:0:8248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acb9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.539278:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acb9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.539291:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acb9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.539298:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acb9d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.539475:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acb9d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.539483:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4a00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601505.539488:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acb9d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.539495:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acb9d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.539604:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd0646400) 00010000:00010000:1.0:1789601505.539608:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601505.539614:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acb9d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.539620:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acb9d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.539633:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.539640:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.539646:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.539652:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601505.539655:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.539672:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.539681:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd0646400) 00010000:00010000:1.0:1789601505.539683:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789601505.539686:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.539692:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acb8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601505.540804:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:11522:x1876532858536576:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 26633us (27957us total) trans 4294967467 rc 0/0 00000100:00100000:1.0:1789601505.540827:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 185 00000020:00080000:1.0:1789601505.540864:0:8248:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789601505.541668:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789601505.541675:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789601505.542449:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1789601505.542461:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789601505.558222:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601505.558323:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858537088 00000100:00100000:1.0:1789601505.558332:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858537088 00000100:00100000:1.0:1789601505.558388:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:1.0:1789601505.558397:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91eddcdac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:11522:x1876532858537088:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789601505.559047:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789601505.559165:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:1.0:1789601505.559212:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acba4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.559232:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acba4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.559245:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acba4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.559265:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acba4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.559272:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acba4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.559278:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acba4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601505.559307:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789601505.559409:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91eddcdac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:11522:x1876532858537088:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 1011us (1198us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1789601505.559419:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00000020:00080000:1.0:1789601505.559424:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789601505.559659:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601505.559668:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acba4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.559687:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4a00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601505.559691:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acba4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.559700:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acba4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.559714:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91edd35e8b00) 00010000:00010000:3.0:1789601505.559717:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789601505.559723:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acba4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.559729:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acba4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601505.559749:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601505.559751:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601505.559753:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601506.313262:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601506.776079:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601506.776895:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601506.776951:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601506.776977:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601506.777003:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601506.777067:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858537600 00000100:00100000:0.0:1789601506.777077:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858537600 00000100:00100000:0.0:1789601506.777148:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858537472 00000100:00100000:0.0:1789601506.777152:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858537472 00000100:00100000:3.0:1789601506.777237:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00100000:3.0:1789601506.777253:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2356:x1876532858537600:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601506.777305:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858537216 00000100:00100000:2.0:1789601506.777309:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858537216 00000100:00100000:2.0:1789601506.777338:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 300 00000100:00100000:2.0:1789601506.777346:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2357:x1876532858537216:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601506.777427:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2357:x1876532858537216:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 80us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601506.777429:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2356:x1876532858537600:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 178us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601506.777442:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 300 00000100:00100000:0.0:1789601506.777605:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 100 00000100:00100000:0.0:1789601506.777614:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2357:x1876532858537472:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601506.777643:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2357:x1876532858537472:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 31us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601506.777649:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 100 00000100:00100000:3.0:1789601506.777722:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00080000:0.0:1789601506.780201:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601506.780557:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858537344 00000100:00100000:1.0:1789601506.780568:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858537344 00000100:00100000:2.0:1789601506.780642:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858537728 00000100:00100000:2.0:1789601506.780646:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858537728 00000100:00100000:2.0:1789601506.780723:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 171 00000100:00100000:2.0:1789601506.780733:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85db4f7d-704a-4080-a137-b2930e072a8c+5:2357:x1876532858537728:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:1.0:1789601506.780818:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601506.780947:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85db4f7d-704a-4080-a137-b2930e072a8c+5:2357:x1876532858537728:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 215us (3941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601506.780954:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 171 00000100:00100000:2.0:1789601506.781199:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 172 00000100:00100000:2.0:1789601506.781247:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:2356:x1876532858537344:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601506.781326:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:2356:x1876532858537344:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 81us (5257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601506.781334:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 172 00000001:00080000:0.0:1789601506.813254:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1789601506.813281:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1789601506.813289:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000040:00080000:3.0:1789601507.193527:0:12547:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789601507.193537:0:12547:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789601507.193576:0:12547:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789601507.193581:0:12547:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789601507.273133:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601507.273173:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee008d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880555136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601507.273258:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601507.273423:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880555136 00000100:00100000:1.0:1789601507.273431:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880555136 00000100:00100000:1.0:1789601507.273496:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789601507.273505:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880555136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601507.273541:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601507.273590:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880555136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601507.273597:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1789601507.273721:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601507.273786:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1789601507.273793:0:3319:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1789601507.273821:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91edffa5a300, transno 4294967307 00000100:00100000:3.0:1789601507.273885:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee008d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880555136:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789601507.339281:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601507.401619:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601507.401777:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858537984 00000100:00100000:0.0:1789601507.401789:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858537984 00000100:00100000:0.0:1789601507.401904:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 186 00000100:00100000:0.0:1789601507.401915:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:11540:x1876532858537984:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789601507.401938:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601507.401961:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158acbab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50612f1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601507.402082:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158acbb2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601507.402102:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158acbb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601507.402115:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158acbb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601507.402136:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000100:00080000:3.0:1789601507.402318:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789601507.402675:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925800/0xf3d6e402158acbab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612f1 expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601507.402698:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158acbb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612f1 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601507.402706:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:0.0:1789601507.402709:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789601507.402713:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00925e00, rc 0) 00000100:00100000:0.0:1789601507.403019:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+24:11540:x1876532858537984:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1104us (1408us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1789601507.403027:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 186 00000100:00100000:3.0:1789601507.405602:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601507.405706:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858538112 00000100:00100000:1.0:1789601507.405719:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858538112 00000100:00100000:1.0:1789601507.405828:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 187 00000100:00100000:1.0:1789601507.405888:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+24:11540:x1876532858538112:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:1.0:1789601507.405971:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbc0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.405990:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406002:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406018:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406026:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406033:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406328:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acbce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406337:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acbce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406344:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acbce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789601507.406389:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acbce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406401:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406413:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbc0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406419:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406425:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601507.406429:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406436:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbc0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406448:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:1.0:1789601507.406450:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601507.406455:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406460:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406473:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406478:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbc7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406482:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406488:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601507.406496:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406501:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406507:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91edd35e8a00) 00010000:00010000:1.0:1789601507.406510:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601507.406513:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbc7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406518:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406532:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acbce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406537:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acbce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406543:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acbce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406547:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4a00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601507.406550:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acbce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406555:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acbce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406561:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:1.0:1789601507.406563:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601507.406572:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acbce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.406577:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acbce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601507.406654:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+24:11540:x1876532858538112:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 769us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601507.406662:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 187 00000100:00100000:2.0:1789601507.445878:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601507.446330:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858538368 00000100:00100000:1.0:1789601507.446341:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858538368 00000100:00100000:1.0:1789601507.446417:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 188 00000100:00100000:1.0:1789601507.446428:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+24:11543:x1876532858538368:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1789601507.446453:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601507.446479:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acbd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50612f8 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.446565:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbdc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.446581:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.446594:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.446609:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbe3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.446616:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.446637:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.447477:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158acbea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.447488:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158acbea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.447499:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158acbea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601507.447510:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789601507.447612:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.447620:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbdc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.447627:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.447633:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601507.447638:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.447645:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbdc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.447658:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:1.0:1789601507.447661:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601507.447674:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.447680:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acbdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.447693:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.447699:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbe3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.447705:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.447710:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601507.447713:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.447719:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbe3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.447727:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91edd35e8500) 00010000:00010000:1.0:1789601507.447729:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601507.447732:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbe3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.447737:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acbe3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.447796:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acbd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612f8 expref: 27 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.447877:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158acbea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612f8 expref: 26 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.447884:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd35e8a00) 00010000:00010000:1.0:1789601507.447887:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601507.447889:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c5c00, rc 0) 00000100:00100000:1.0:1789601507.447968:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+26:11543:x1876532858538368:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1541us (2153us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789601507.447977:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 188 00000100:00100000:0.0:1789601507.455957:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601507.456829:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858538496 00000100:00100000:2.0:1789601507.456996:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858538496 00000100:00100000:2.0:1789601507.457096:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 189 00000100:00100000:2.0:1789601507.457115:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+26:11543:x1876532858538496:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:2.0:1789601507.457336:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158acbf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.457355:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158acbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.457368:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158acbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.457396:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158acbf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.457404:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158acbf8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.457412:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158acbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.457418:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601507.457423:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158acbf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.457431:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158acbf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.457444:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd35e8a00) 00010000:00010000:2.0:1789601507.457448:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789601507.457453:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158acbf8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.457471:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158acbf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601507.457581:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+26:11543:x1876532858538496:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 475us (1635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601507.457589:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 189 00000100:00100000:3.0:1789601507.460732:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601507.460885:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858538752 00000100:00100000:1.0:1789601507.460898:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858538752 00000100:00100000:1.0:1789601507.460954:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:1.0:1789601507.460964:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+26:11543:x1876532858538752:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1789601507.461433:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+27:11543:x1876532858538752:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 468us (706us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789601507.461441:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:3.0:1789601507.502375:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601507.503624:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858539008 00000100:00100000:0.0:1789601507.503638:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858539008 00000100:00100000:1.0:1789601507.503902:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 190 00000100:00100000:1.0:1789601507.503913:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+27:11069:x1876532858539008:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:1.0:1789601507.503936:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601507.503957:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acbff lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50612ff expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.504067:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acc06 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.504101:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158acbea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612f8 expref: 28 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.504118:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acc06 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.504156:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158acbea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612f8 expref: 28 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.504178:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158acbea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612f8 expref: 28 pid: 8248 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601507.504192:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee008d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1876532880555264:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789601507.504351:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7ed4900 going to sleep for 11 seconds 00000100:00100000:1.0:1789601507.508099:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee008d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1876532880555264:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601507.508144:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acc06 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601507.518516:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601507.518697:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858539136 00000100:00100000:1.0:1789601507.518707:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858539136 00010000:00010000:1.0:1789601507.518759:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158acbea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612f8 expref: 29 pid: 8248 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601507.518803:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 74 00000100:00100000:1.0:1789601507.518814:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+29:2357:x1876532858539136:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601507.518829:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601507.518887:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158acbea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612f8 expref: 29 pid: 8248 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.518902:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158acbea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612f8 expref: 29 pid: 8248 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.518925:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158acbea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612f8 expref: 29 pid: 8248 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.518944:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd35e8a00) 00010000:00010000:1.0:1789601507.518949:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acc06 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.518959:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acc06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.518967:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acc06 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.519004:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601507.519065:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+28:2357:x1876532858539136:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 253us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601507.519073:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 74 00010000:00010000:3.0:1789601507.519575:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acc06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.519585:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acc06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601507.519605:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789601507.519816:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acbff lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ff expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.519876:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acc06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ff expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.519886:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd35e8a00) 00010000:00010000:3.0:1789601507.519889:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789601507.519892:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c5e00, rc 0) 00000100:00100000:3.0:1789601507.519942:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+28:11069:x1876532858539008:12345-192.168.201.30@tcp:101:bash.0 Request processed in 16031us (17579us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1789601507.519958:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 190 00000100:00100000:3.0:1789601507.524278:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601507.524350:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858539392 00000100:00100000:1.0:1789601507.524361:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858539392 00000100:00100000:1.0:1789601507.524436:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 191 00000100:00100000:1.0:1789601507.524447:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+28:11069:x1876532858539392:12345-192.168.201.30@tcp:36:bash.0 00010000:00010000:1.0:1789601507.524728:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.524776:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.524789:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789601507.524885:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:1.0:1789601507.524911:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1d0c0f1 reply state 000000007dad29e0 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601507.524921:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789601507.524965:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:1.0:1789601507.525069:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+32:11069:x1876532858539392:12345-192.168.201.30@tcp:36:bash.0 Request processed in 624us (799us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1789601507.525076:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 191 00000020:00080000:1.0:1789601507.525081:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1789601507.527608:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.527626:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.527634:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.527641:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601507.527647:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.527655:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.527691:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd35e8a00) 00010000:00010000:1.0:1789601507.527694:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601507.527699:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.527704:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601507.529434:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601507.531245:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858539520 00000100:00100000:2.0:1789601507.531260:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858539520 00000100:00100000:2.0:1789601507.531372:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 192 00000100:00100000:2.0:1789601507.531383:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+31:11069:x1876532858539520:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1789601507.531414:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601507.531437:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158acc1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061306 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.531500:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158acc1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061306 expref: 32 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.531514:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158acc1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061306 expref: 32 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.531531:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd35e8a00) 00010000:00010000:2.0:1789601507.531534:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789601507.531538:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8d800, rc 0) 00000100:00100000:2.0:1789601507.531609:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+32:11069:x1876532858539520:12345-192.168.201.30@tcp:101:bash.0 Request processed in 228us (2184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601507.531616:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 192 00000100:00100000:0.0:1789601507.535320:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601507.535420:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858539648 00000100:00100000:2.0:1789601507.535431:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858539648 00000100:00100000:2.0:1789601507.535502:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:2.0:1789601507.535513:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edefeb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:11069:x1876532858539648:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1789601507.535534:0:11670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601507.535557:0:11670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007819e969/0xf3d6e402158acc22 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506130d expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789601507.535584:0:11670:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aab26e1, atime: 0x6aab26df, ctime: 0x6aab26e1, blocks: 0xb 00010000:00010000:2.0:1789601507.535610:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=377s v=(0 0) 00010000:00010000:2.0:1789601507.535614:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601507.535621:0:11670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007819e969/0xf3d6e402158acc22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506130d expref: 8 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.535637:0:11670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007819e969/0xf3d6e402158acc22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506130d expref: 8 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.535649:0:11670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8c600, rc 0) 00000100:00100000:2.0:1789601507.535726:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edefeb2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:11069:x1876532858539648:12345-192.168.201.30@tcp:101:bash.0 Request processed in 214us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601507.535733:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00080000:3.0:1789601507.536388:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789601507.539439:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601507.539574:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858539776 00000100:00100000:2.0:1789601507.539585:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858539776 00002000:00010000:2.0:1789601507.539635:0:6684:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1789601507.539640:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91edf8b19f80 with x1876532858539776 ext(0->18446744073709551615) 00002000:00010000:2.0:1789601507.539651:0:6684:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91edf8b19f80. 00000100:00100000:2.0:1789601507.539683:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:2.0:1789601507.539707:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2359:x1876532858539776:12345-192.168.201.30@tcp:10:bash.0 00002000:00010000:2.0:1789601507.540024:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789601507.540028:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789601505 -> 1789601508 00002000:00010000:2.0:1789601507.540030:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789601503 -> 1789601503 00002000:00010000:2.0:1789601507.540033:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789601505 -> 1789601508 00002000:00010000:2.0:1789601507.540035:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789601507.540100:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:2359:x1876532858539776:12345-192.168.201.30@tcp:10:bash.0 Request processed in 395us (670us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789601507.540582:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00002000:00010000:2.0:1789601507.540587:0:6684:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1789601507.540590:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91edf8b19f80 with x1876532858539776 ext(0->18446744073709551615) 00002000:00010000:2.0:1789601507.540596:0:6684:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91edf8b19f80. 00000100:00100000:1.0:1789601507.639750:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601507.639898:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858539904 00000100:00100000:3.0:1789601507.639911:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858539904 00000100:00100000:3.0:1789601507.639976:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 193 00000100:00100000:3.0:1789601507.639987:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+32:11557:x1876532858539904:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:3.0:1789601507.640088:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640107:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640120:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640136:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640144:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640150:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640388:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acc37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640412:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acc37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640430:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acc37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601507.640469:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acc37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640480:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640486:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640493:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640498:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601507.640503:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640509:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640519:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:3.0:1789601507.640522:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601507.640527:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640534:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640545:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640558:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640564:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640569:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601507.640572:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640578:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640586:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91edd8ce5a00) 00010000:00010000:3.0:1789601507.640589:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601507.640592:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640598:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640613:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acc37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640619:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acc37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640625:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acc37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640630:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601507.640640:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acc37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640647:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acc37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640656:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd35e8a00) 00010000:00010000:3.0:1789601507.640659:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601507.640662:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acc37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.640668:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acc37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601507.640739:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+32:11557:x1876532858539904:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 752us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601507.640747:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 193 00000100:00100000:0.0:1789601507.695110:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601507.695281:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858540160 00000100:00100000:3.0:1789601507.695292:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858540160 00000100:00100000:3.0:1789601507.695411:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 194 00000100:00100000:3.0:1789601507.695421:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+32:11560:x1876532858540160:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601507.695442:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601507.695464:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acc3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061314 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.695534:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.695548:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.695577:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.695594:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.695602:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.695608:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.696193:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acc53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.696204:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acc53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.696212:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acc53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601507.696223:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789601507.696317:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.696325:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.696332:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.696338:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601507.696348:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.696356:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.696368:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:3.0:1789601507.696371:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601507.696375:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.696382:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158acc45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.696443:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.696450:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.696456:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.696461:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601507.696464:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.696471:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.696479:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91edd8ce5a00) 00010000:00010000:3.0:1789601507.696481:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601507.696490:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.696496:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158acc4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.696541:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158acc3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061314 expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.696555:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acc53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061314 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.696562:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd35e8a00) 00010000:00010000:3.0:1789601507.696565:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789601507.696567:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88600, rc 0) 00000100:00100000:3.0:1789601507.696691:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+34:11560:x1876532858540160:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1271us (1589us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789601507.696699:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 194 00000100:00100000:3.0:1789601507.699630:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601507.702055:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858540288 00000100:00100000:1.0:1789601507.702072:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858540288 00000100:00100000:1.0:1789601507.702151:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 195 00000100:00100000:1.0:1789601507.702163:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+34:11560:x1876532858540288:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:1.0:1789601507.702245:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.702262:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acc06 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ff expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.702273:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc61 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.702308:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acc06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ff expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.702323:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acc06 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ff expref: 34 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601507.702338:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee008d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1876532880555392:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789601507.703362:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7ed4900 going to sleep for 11 seconds 00000100:00100000:1.0:1789601507.712745:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601507.712896:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee008d7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1876532880555392:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601507.712925:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601507.713181:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858540544 00000100:00100000:2.0:1789601507.713190:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858540544 00000100:00100000:2.0:1789601507.713252:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:2.0:1789601507.713262:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+35:5596:x1876532858540544:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789601507.713611:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+36:5596:x1876532858540544:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 350us (876us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1789601507.713620:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:3.0:1789601507.719989:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601507.720304:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858540672 00000100:00100000:2.0:1789601507.720316:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858540672 00010000:00010000:2.0:1789601507.720356:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acc06 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ff expref: 36 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601507.720407:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 75 00000100:00100000:2.0:1789601507.720418:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+36:2356:x1876532858540672:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601507.720444:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601507.720452:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acc06 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ff expref: 36 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.720466:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acc06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ff expref: 36 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.720487:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acc06 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612ff expref: 36 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.720504:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd35e8a00) 00010000:00010000:2.0:1789601507.720510:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.720520:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.720528:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc61 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.720558:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601507.720578:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.720586:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601507.720614:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+35:2356:x1876532858540672:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 197us (633us total) trans 0 rc 0/0 00010000:00010000:3.0:1789601507.720622:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601507.720623:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 75 00010000:00010000:3.0:1789601507.720631:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.720637:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.720641:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601507.720644:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.720649:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.720656:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd35e8a00) 00010000:00010000:3.0:1789601507.720658:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601507.720661:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.720665:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acc61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601507.720700:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+34:11560:x1876532858540288:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 18540us (21080us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601507.720705:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 195 00000100:00100000:0.0:1789601507.726365:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601507.728520:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858540928 00000100:00100000:2.0:1789601507.728536:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858540928 00000100:00100000:2.0:1789601507.728642:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:2.0:1789601507.728655:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+34:11560:x1876532858540928:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789601507.728969:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+35:11560:x1876532858540928:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 316us (2613us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1789601507.728976:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:1.0:1789601507.850711:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601507.850806:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858541184 00000100:00100000:2.0:1789601507.850817:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858541184 00000100:00100000:2.0:1789601507.850941:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 196 00000100:00100000:2.0:1789601507.850953:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+35:11571:x1876532858541184:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:2.0:1789601507.850979:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601507.851000:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158acc68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506131b expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.851091:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.851114:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.851126:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.851139:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.851146:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.851521:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.851975:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158acc7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.851991:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158acc7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.851999:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158acc7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601507.852009:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789601507.852326:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.852335:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.852342:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.852349:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601507.852353:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.852359:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.852371:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:2.0:1789601507.852374:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601507.852379:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.852386:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.852398:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.852409:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.852415:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.852419:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8cc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601507.852422:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.852427:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.852434:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91edd8a67100) 00010000:00010000:2.0:1789601507.852436:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601507.852439:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.852444:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.852544:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158acc68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506131b expref: 38 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.852558:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158acc7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506131b expref: 37 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.852565:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd35e8a00) 00010000:00010000:2.0:1789601507.852567:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601507.852573:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8d000, rc 0) 00000100:00100000:2.0:1789601507.852638:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+37:11571:x1876532858541184:12345-192.168.201.30@tcp:101:cat.0 Request processed in 1688us (1939us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1789601507.852646:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 196 00000100:00100000:3.0:1789601507.862511:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601507.862671:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858541440 00000100:00100000:1.0:1789601507.862683:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858541440 00000100:00100000:1.0:1789601507.862745:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:1.0:1789601507.862757:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf80a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+37:11571:x1876532858541440:12345-192.168.201.30@tcp:35:cat.0 00000100:00100000:1.0:1789601507.863051:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf80a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+38:11571:x1876532858541440:12345-192.168.201.30@tcp:35:cat.0 Request processed in 295us (550us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789601507.863060:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 54 00000100:00100000:0.0:1789601507.908668:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601507.908763:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858541696 00000100:00100000:2.0:1789601507.908775:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858541696 00000100:00100000:2.0:1789601507.908865:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 197 00000100:00100000:2.0:1789601507.908877:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+38:11572:x1876532858541696:12345-192.168.201.30@tcp:36:rm.0 00010000:00010000:2.0:1789601507.908944:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789601507.908972:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158acc7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506131b expref: 38 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.908997:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158acc53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061314 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.909010:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158acc1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061306 expref: 36 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.909019:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd35e8a00) 00010000:00010000:2.0:1789601507.909040:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601507.909064:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158acc8b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.909078:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158acc8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.909098:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158acc8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.909132:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.909139:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.909146:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.909567:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc99 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.909576:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.909583:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789601507.910737:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1789601507.910755:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 377948917769ns, next at 378948913887ns, rc = 0 00010000:00010000:2.0:1789601507.910830:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acca0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.910871:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acca0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.910882:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acca0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.910890:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acca0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.910908:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acca0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.910913:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acca0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.910986:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601507.911010:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.911016:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc99 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.911022:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc99 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.911027:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601507.911040:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc99 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.911047:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc99 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.911059:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8a67d00) 00010000:00010000:2.0:1789601507.911061:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789601507.911066:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc99 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.911071:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acc99 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.911113:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158acc8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.911127:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158acc8b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.911133:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158acc8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.911137:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8dc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601507.911141:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158acc8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.911146:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158acc8b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.911163:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:2.0:1789601507.911165:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601507.911168:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158acc8b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.911173:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158acc8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789601507.911182:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051cfa72e reply state 000000000d19a7bf transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601507.911191:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789601507.911286:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+37:11572:x1876532858541696:12345-192.168.201.30@tcp:36:rm.0 Request processed in 2409us (2628us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789601507.911294:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 197 00010000:00010000:2.0:1789601507.915979:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.916021:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.916038:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.916045:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8cc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601507.916050:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.916059:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.916076:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91edd8a67100) 00010000:00010000:2.0:1789601507.916080:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601507.916097:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.916104:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acc92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.916364:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601507.916372:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acca0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.916379:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d400 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601507.916382:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acca0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.916387:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acca0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.916396:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91edd8a67d00) 00010000:00010000:1.0:1789601507.916399:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789601507.916402:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acca0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.916407:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acca0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.916424:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601507.916433:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601507.916434:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601507.966234:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601507.966306:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858541952 00000100:00100000:3.0:1789601507.966317:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858541952 00000100:00100000:3.0:1789601507.966439:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 198 00000100:00100000:3.0:1789601507.966450:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+36:11578:x1876532858541952:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789601507.966483:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601507.966504:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158acca7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061322 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.966622:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158accae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.966637:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158accae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.966651:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158accae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.966666:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158accb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.966673:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158accb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.966680:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158accb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789601507.967276:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789601507.967433:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158accbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.967443:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158accbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.967451:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158accbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.967493:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158accae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.967502:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158accae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.967510:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158accae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.967516:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601507.967521:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158accae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.967529:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158accae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.967541:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:3.0:1789601507.967544:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601507.967549:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158accae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.967555:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158accae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601507.967569:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1f8f3f4 reply state 00000000b79e9602 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158accb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601507.967578:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789601507.967609:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158acca7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061322 expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.967637:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158accbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061322 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601507.967644:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd8ce5500) 00010000:00010000:3.0:1789601507.967647:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601507.967649:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadca00, rc 0) 00000100:00100000:3.0:1789601507.967727:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+39:11578:x1876532858541952:12345-192.168.201.30@tcp:101:bash.0 Request processed in 1279us (1504us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1789601507.967736:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 198 00000100:00100000:3.0:1789601507.972622:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601507.972703:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858542080 00000100:00100000:2.0:1789601507.972713:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858542080 00000100:00100000:2.0:1789601507.972757:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:2.0:1789601507.972764:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2356:x1876532858542080:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1789601507.972780:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601507.972797:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b18cfa36/0xf3d6e402158accca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061329 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789601507.972874:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789601507.972895:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=378s v=(0 0) 00010000:00010000:2.0:1789601507.972899:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601507.972909:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b18cfa36/0xf3d6e402158accca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061329 expref: 6 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.972927:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b18cfa36/0xf3d6e402158accca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061329 expref: 6 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.972940:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8cc00, rc 0) 00000100:00100000:2.0:1789601507.973000:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2356:x1876532858542080:12345-192.168.201.30@tcp:101:bash.0 Request processed in 236us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601507.973007:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00010000:00010000:1.0:1789601507.973607:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158accb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.973619:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158accb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.973626:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158accb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.973632:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadce00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601507.973636:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158accb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.973644:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158accb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.973659:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91edd8ce5a00) 00010000:00010000:1.0:1789601507.973663:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601507.973667:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158accb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.973678:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158accb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601507.977080:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601507.977153:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858542208 00000100:00100000:2.0:1789601507.977165:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858542208 00000100:00100000:2.0:1789601507.977225:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:2.0:1789601507.977236:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:11578:x1876532858542208:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:2.0:1789601507.977264:0:11670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601507.977282:0:11670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158accd1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061330 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.977316:0:11670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b18cfa36/0xf3d6e402158accca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061329 expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.977344:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601507.977348:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601507.977354:0:11670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158accd1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061330 expref: 7 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.977389:0:11670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b18cfa36/0xf3d6e402158accca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061329 expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601507.977404:0:11670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b18cfa36/0xf3d6e402158accca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061329 expref: 7 pid: 6676 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601507.977417:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00661f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11670:1876532880555520:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789601507.977522:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc23d1600 going to sleep for 11 seconds 00000100:00100000:3.0:1789601507.984553:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601507.984630:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858542336 00000100:00100000:1.0:1789601507.984646:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858542336 00010000:00010000:1.0:1789601507.984689:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b18cfa36/0xf3d6e402158accca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061329 expref: 8 pid: 6676 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601507.984703:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00661f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11670:1876532880555520:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789601507.984729:0:11670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158accd1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061330 expref: 8 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601507.984743:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 76 00010000:00010000:2.0:1789601507.984754:0:11670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8dc00, rc 0) 00000100:00100000:1.0:1789601507.984772:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede51e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2357:x1876532858542336:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601507.984790:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601507.984812:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b18cfa36/0xf3d6e402158accca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061329 expref: 8 pid: 6676 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.984828:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b18cfa36/0xf3d6e402158accca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061329 expref: 8 pid: 6676 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.984884:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b18cfa36/0xf3d6e402158accca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061329 expref: 8 pid: 6676 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.984900:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601507.984904:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601507.984912:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158accd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061330 expref: 7 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.984922:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158accd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061330 expref: 7 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601507.984956:0:8437:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158accd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061330 expref: 7 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601507.984970:0:8437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee008d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8437:1876532880555648:192.168.201.30@tcp:105: 00000100:00100000:1.0:1789601507.985021:0:8437:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7ed4840 going to sleep for 11 seconds 00000100:00100000:2.0:1789601507.987060:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:11578:x1876532858542208:12345-192.168.201.30@tcp:101:bash.0 Request processed in 7586us (7748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601507.987074:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:1.0:1789601507.990591:0:8437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee008d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8437:1876532880555648:192.168.201.30@tcp:105: 00010000:00010000:1.0:1789601507.990636:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601507.990708:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede51e2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858542336:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 5939us (6166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601507.990721:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:0.0:1789601507.992655:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601507.992974:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858542592 00000100:00100000:1.0:1789601507.992985:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858542592 00000100:00100000:1.0:1789601507.993046:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:1.0:1789601507.993056:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+38:11578:x1876532858542592:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:1.0:1789601507.993688:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+39:11578:x1876532858542592:12345-192.168.201.30@tcp:35:bash.0 Request processed in 631us (1038us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789601507.993696:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 55 00000100:00100000:3.0:1789601508.272641:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601508.272719:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858542720 00000100:00100000:1.0:1789601508.272728:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858542720 00000100:00100000:1.0:1789601508.272788:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 199 00000100:00100000:1.0:1789601508.272799:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edd8d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+39:11594:x1876532858542720:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1789601508.272823:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601508.272880:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158accd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061337 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.272943:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158accdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.272953:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158accdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.272962:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158accdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601508.273013:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789601508.273015:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789601508.273040:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158accdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.273066:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158accd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061337 expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.273084:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158accdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061337 expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.273093:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:1.0:1789601508.273109:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789601508.273113:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c4e00, rc 0) 00000100:00100000:1.0:1789601508.273471:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edd8d92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+40:11594:x1876532858542720:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 673us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601508.273479:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 199 00000100:00100000:0.0:1789601508.282227:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601508.282453:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858542976 00000100:00100000:3.0:1789601508.282474:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858542976 00000100:00100000:3.0:1789601508.282587:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 200 00000100:00100000:3.0:1789601508.282597:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+40:11594:x1876532858542976:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601508.282621:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601508.282644:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158acce6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506133e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.282745:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158acced lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.282759:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158acced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.282770:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158acced lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601508.282795:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789601508.282962:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158acce6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506133e expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.282980:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158acced lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506133e expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.282988:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd8ce5500) 00010000:00010000:3.0:1789601508.282991:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601508.282994:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc200, rc 0) 00000100:00100000:3.0:1789601508.283100:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+42:11594:x1876532858542976:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 497us (876us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1789601508.283108:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 200 00000100:00100000:2.0:1789601508.290451:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601508.291852:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601508.292064:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858543104 00000100:00100000:2.0:1789601508.292075:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858543104 00000100:00100000:2.0:1789601508.292172:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:2.0:1789601508.292183:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+42:2356:x1876532858543104:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601508.292200:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601508.292224:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158acced lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506133e expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.292244:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd8ce5500) 00010000:00010000:2.0:1789601508.292250:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601508.292318:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+41:2356:x1876532858543104:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 138us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601508.292326:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:0.0:1789601508.296231:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858543360 00000100:00100000:0.0:1789601508.296247:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858543360 00000100:00100000:0.0:1789601508.296330:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 201 00000100:00100000:0.0:1789601508.296342:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+41:11594:x1876532858543360:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789601508.296384:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601508.296580:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158accfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061345 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.296697:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158acd02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.296712:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158acd02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.296724:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158acd02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601508.296735:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789601508.296899:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924000/0xf3d6e402158accfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061345 expref: 44 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.296921:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158acd02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061345 expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.296932:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd8ce5500) 00010000:00010000:0.0:1789601508.296935:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789601508.296938:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00925000, rc 0) 00000100:00100000:0.0:1789601508.297007:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+43:11594:x1876532858543360:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 667us (6567us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1789601508.297015:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 201 00000100:00100000:3.0:1789601508.306976:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601508.307633:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858543488 00000100:00100000:2.0:1789601508.307647:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858543488 00000100:00100000:2.0:1789601508.307734:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:2.0:1789601508.307745:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+6:2357:x1876532858543488:12345-192.168.201.30@tcp:1:lfs.0 00010000:00010000:2.0:1789601508.307793:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035b82c33/0xf3d6e402158acd10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.307817:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158accd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061330 expref: 6 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.307862:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601508.307866:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789601508.307871:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035b82c33/0xf3d6e402158acd10 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.307910:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158accd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061330 expref: 6 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.307940:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158accd1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061330 expref: 6 pid: 11670 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601508.307954:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00661880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1876532880555776:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789601508.308075:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc23d1600 going to sleep for 11 seconds 00000100:00080000:3.0:1789601508.309875:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601508.310765:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601508.310875:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858543616 00000100:00100000:0.0:1789601508.310885:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858543616 00002000:00100000:0.0:1789601508.310952:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff91ee00662680 x1876532858543616/t0(0) o4->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:104/0 lens 504/0 e 0 to 0 dl 1789601519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789601508.310976:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91ee00662680 with x1876532858543616 ext(0->8) 00010000:00010000:0.0:1789601508.310985:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158accd1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061330 expref: 7 pid: 11670 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.311001:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158accd1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061330 expref: 7 pid: 11670 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789601508.311008:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91ee00662680 00000100:00100000:0.0:1789601508.311048:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:0.0:1789601508.311057:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2359:x1876532858543616:12345-192.168.201.30@tcp:4:lfs.0 00000100:00100000:3.0:1789601508.311864:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00661880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1876532880555776:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601508.311893:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000035b82c33/0xf3d6e402158acd10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601508.311994:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:2359:x1876532858543616:12345-192.168.201.30@tcp:4:lfs.0 Request processed in 936us (1235us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789601508.312002:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00002000:00100000:0.0:1789601508.312010:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff91ee00662680 x1876532858543616/t4294967308(0) o4->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:104/0 lens 504/448 e 0 to 0 dl 1789601519 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789601508.312018:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91ee00662680 with x1876532858543616 ext(0->8) 00010000:00010000:0.0:1789601508.312033:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158accd1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061330 expref: 9 pid: 11670 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.312046:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158accd1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061330 expref: 9 pid: 11670 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789601508.312052:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff91ee00662680 00000100:00100000:2.0:1789601508.321434:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601508.321756:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858543744 00000100:00100000:3.0:1789601508.321767:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858543744 00010000:00010000:3.0:1789601508.321828:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158accd1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061330 expref: 9 pid: 11670 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601508.321893:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:3.0:1789601508.321914:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00662d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:2357:x1876532858543744:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601508.321928:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789601508.321945:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789601508.321947:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789601509 00002000:00010000:3.0:1789601508.321949:0:5824:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789601509 00002000:00010000:3.0:1789601508.321951:0:5824:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789601509 00010000:00010000:3.0:1789601508.321955:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158accd1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061330 expref: 9 pid: 11670 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.321964:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158accd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061330 expref: 9 pid: 11670 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.321982:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158accd1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061330 expref: 9 pid: 11670 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.322000:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789601508.322003:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789601508.322010:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000035b82c33/0xf3d6e402158acd10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.322019:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035b82c33/0xf3d6e402158acd10 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.322064:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601508.322127:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00662d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2357:x1876532858543744:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 213us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601508.322134:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 77 00010000:00010000:2.0:1789601508.322221:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000035b82c33/0xf3d6e402158acd10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.322231:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035b82c33/0xf3d6e402158acd10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.322254:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035b82c33/0xf3d6e402158acd10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.322263:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035b82c33/0xf3d6e402158acd10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.322270:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035b82c33/0xf3d6e402158acd10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.322277:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8de00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601508.322281:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035b82c33/0xf3d6e402158acd10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.322296:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035b82c33/0xf3d6e402158acd10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.322308:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035b82c33/0xf3d6e402158acd10 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.322316:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035b82c33/0xf3d6e402158acd10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601508.322369:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2357:x1876532858543488:12345-192.168.201.30@tcp:1:lfs.0 Request processed in 14626us (15408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601508.322377:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:1.0:1789601508.325659:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601508.325717:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858544000 00000100:00100000:2.0:1789601508.325727:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858544000 00000100:00100000:2.0:1789601508.325784:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 56 00000100:00100000:2.0:1789601508.325794:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91eddcdaec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+43:11594:x1876532858544000:12345-192.168.201.30@tcp:35:lfs.0 00000004:00010000:2.0:1789601508.325887:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158acd02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061345 expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789601508.326258:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1789601508.326306:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1789601508.326673:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:2.0:1789601508.326715:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158acd17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.326729:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158accbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061322 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.326754:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158acd17 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.326792:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158accbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061322 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.326808:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158accbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061322 expref: 47 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601508.327241:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00661c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1876532880555904:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789601508.327361:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc23d13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601508.337491:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601508.337564:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858544128 00000100:00100000:3.0:1789601508.337574:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858544128 00010000:00010000:3.0:1789601508.337613:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158accbc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061322 expref: 48 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601508.337658:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:3.0:1789601508.337669:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00662a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+48:2357:x1876532858544128:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601508.337688:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601508.337696:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158accbc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061322 expref: 48 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.337709:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158accbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061322 expref: 48 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.337733:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd8ce5500) 00010000:00010000:3.0:1789601508.337739:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158acd17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.337748:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158acd17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.337756:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158acd17 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.337775:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601508.337856:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00662a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+48:2357:x1876532858544128:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 168us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601508.337864:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 78 00010000:00010000:1.0:1789601508.338495:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158accbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061322 expref: 47 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601508.338514:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00661c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1876532880555904:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601508.338538:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158acd17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.338548:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158acd17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.338574:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158acd17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789601508.338709:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1789601508.338960:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1789601508.339429:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee008d4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1876532880556032:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789601508.339495:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601508.339587:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7ed4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789601508.341729:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880556032 00000100:00100000:2.0:1789601508.341744:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880556032 00000100:00100000:2.0:1789601508.342115:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789601508.342129:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1876532880556032:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789601508.342628:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1876532880556032:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 502us (3130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601508.342637:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789601508.343102:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee008d4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1876532880556032:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789601508.343653:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1789601508.343735:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edfff53100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1876532880556160:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789601508.344292:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601508.344780:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede9e69540 going to sleep for 11 seconds 00000100:00100000:1.0:1789601508.344947:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880556160 00000100:00100000:1.0:1789601508.344957:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880556160 00000100:00100000:1.0:1789601508.345000:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789601508.345008:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1876532880556160:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789601508.345242:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1876532880556160:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 234us (951us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789601508.345249:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789601508.345556:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edfff53100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1876532880556160:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789601508.345622:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1789601508.345666:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158acd17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.345676:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158acd17 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.345700:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158acd17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.345707:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8ce00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601508.345712:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158acd17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.345721:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158acd17 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.345735:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd8ce5500) 00010000:00010000:3.0:1789601508.345738:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789601508.345743:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158acd17 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.345749:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8ce00/0xf3d6e402158acd17 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789601508.345991:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789601508.346114:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1789601508.346128:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378384290156ns, next at 379384286677ns, rc = 0 00000001:00080000:3.0:1789601508.346134:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1789601508.346516:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd8ce5500) 00010000:00010000:3.0:1789601508.346520:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789601508.346528:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158acd02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061345 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601508.346641:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91eddcdaec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+50:11594:x1876532858544000:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 20849us (20991us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1789601508.346650:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 56 00000020:00080000:3.0:1789601508.346655:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789601508.353657:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601508.353761:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858544256 00000100:00100000:1.0:1789601508.353774:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858544256 00000100:00100000:1.0:1789601508.353866:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 202 00000100:00100000:1.0:1789601508.353877:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+50:11594:x1876532858544256:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1789601508.353904:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601508.353932:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158acd1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506134c expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.353993:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158acd1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506134c expref: 51 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.354008:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158acd1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506134c expref: 51 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.354054:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:1.0:1789601508.354058:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789601508.354062:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c5c00, rc 0) 00000100:00100000:1.0:1789601508.354183:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+51:11594:x1876532858544256:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 308us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601508.354191:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 202 00010000:00010000:2.0:1789601508.365009:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601508.365367:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601508.365494:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858544512 00000100:00100000:3.0:1789601508.365504:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858544512 00000100:00100000:3.0:1789601508.365558:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:3.0:1789601508.365567:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+51:11594:x1876532858544512:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1789601508.365818:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+52:11594:x1876532858544512:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 251us (459us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789601508.365825:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 57 00000100:00100000:0.0:1789601508.482589:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601508.482974:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858544640 00000100:00100000:1.0:1789601508.482985:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858544640 00000100:00100000:1.0:1789601508.483049:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 203 00000100:00100000:1.0:1789601508.483062:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+52:11605:x1876532858544640:12345-192.168.201.30@tcp:34:lfs.0 00010000:00010000:1.0:1789601508.483932:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.483955:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.483967:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.483982:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acd2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.483989:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acd2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.483996:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acd2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485088:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acd33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485104:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acd33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485115:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acd33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789601508.485175:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acd33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485189:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485195:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd25 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485211:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485218:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601508.485221:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485228:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd25 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485241:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:0.0:1789601508.485243:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601508.485249:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485274:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485291:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acd2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485297:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acd2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485304:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acd2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485309:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4a00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601508.485312:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acd2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485317:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acd2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485326:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91edd35e8900) 00010000:00010000:0.0:1789601508.485329:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601508.485331:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acd2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485337:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acd2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485352:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acd33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485357:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acd33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485369:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acd33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485374:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601508.485377:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acd33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485383:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acd33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485402:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:0.0:1789601508.485405:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601508.485408:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acd33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.485413:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acd33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601508.485520:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+52:11605:x1876532858544640:12345-192.168.201.30@tcp:34:lfs.0 Request processed in 2457us (2937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601508.485531:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 203 00000100:00100000:2.0:1789601508.601963:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601508.602234:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858544896 00000100:00100000:1.0:1789601508.602507:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858544896 00000100:00100000:1.0:1789601508.602613:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 204 00000100:00100000:1.0:1789601508.602623:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+52:11608:x1876532858544896:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1789601508.602646:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601508.602670:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acd3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061353 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.602743:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd41 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.602758:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.602770:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.602786:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acd48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.602794:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acd48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.602801:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acd48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.602947:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167400/0xf3d6e402158acd4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.602955:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167400/0xf3d6e402158acd4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.602963:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167400/0xf3d6e402158acd4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601508.602978:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789601508.603137:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.603145:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd41 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.603151:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.603157:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601508.603161:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.603169:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd41 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.603180:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:1.0:1789601508.603183:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601508.603187:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.603192:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acd41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.603205:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acd48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.603210:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acd48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.603225:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acd48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.603230:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee02167e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601508.603233:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acd48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.603238:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acd48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.603245:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91edd35e8900) 00010000:00010000:1.0:1789601508.603248:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601508.603261:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acd48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.603267:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acd48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.603309:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158acd3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061353 expref: 55 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.603323:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167400/0xf3d6e402158acd4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061353 expref: 54 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.603329:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:1.0:1789601508.603331:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601508.603334:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee02167400, rc 0) 00000100:00100000:1.0:1789601508.603410:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+54:11608:x1876532858544896:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 788us (1459us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789601508.603427:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 204 00000100:00100000:2.0:1789601508.612103:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601508.612369:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858545024 00000100:00100000:0.0:1789601508.612382:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858545024 00000100:00100000:0.0:1789601508.612444:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 205 00000100:00100000:0.0:1789601508.612454:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+54:11608:x1876532858545024:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:0.0:1789601508.612520:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acd5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.612537:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acd5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.612562:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acd5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.612586:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acd5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.612592:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acd5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.612598:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acd5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.612604:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601508.612608:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acd5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.612614:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acd5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.612625:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:0.0:1789601508.612629:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789601508.612633:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acd5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.612640:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acd5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601508.612742:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+54:11608:x1876532858545024:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 289us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601508.612749:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 205 00000100:00100000:0.0:1789601508.621954:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601508.622087:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858545280 00000100:00100000:1.0:1789601508.622099:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858545280 00000100:00100000:1.0:1789601508.622157:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:1.0:1789601508.622167:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+54:11608:x1876532858545280:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:1.0:1789601508.623322:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:11608:x1876532858545280:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 911us (1132us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789601508.623333:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 58 00000100:00100000:2.0:1789601508.717816:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601508.718068:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858545536 00000100:00100000:3.0:1789601508.718079:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858545536 00000100:00100000:1.0:1789601508.718247:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 206 00000100:00100000:1.0:1789601508.718261:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:11618:x1876532858545536:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:1.0:1789601508.718290:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601508.718294:0:8248:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789601508.718321:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158accdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061337 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.718342:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:1.0:1789601508.718347:0:8248:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789601508.718362:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acd64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506135a expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.718461:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158acd6b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.718476:0:8248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167400/0xf3d6e402158acd4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061353 expref: 55 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.718677:0:8248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158acd6b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.718712:0:8248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167400/0xf3d6e402158acd4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061353 expref: 55 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.718725:0:8248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167400/0xf3d6e402158acd4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061353 expref: 55 pid: 8248 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601508.718739:0:8248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee008d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880556288:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789601508.718832:0:8248:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7ed46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601508.723643:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601508.723703:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858545664 00000100:00100000:3.0:1789601508.723715:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858545664 00010000:00010000:3.0:1789601508.723760:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167400/0xf3d6e402158acd4f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061353 expref: 56 pid: 8248 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601508.723889:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:3.0:1789601508.723901:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00663b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+56:2357:x1876532858545664:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601508.723935:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601508.723942:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167400/0xf3d6e402158acd4f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061353 expref: 56 pid: 8248 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.723962:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167400/0xf3d6e402158acd4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061353 expref: 56 pid: 8248 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.723986:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:3.0:1789601508.723992:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158acd6b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.724003:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158acd6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.724011:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158acd6b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.724041:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167400/0xf3d6e402158acd4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061353 expref: 56 pid: 8248 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.724047:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601508.724106:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00663b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:2357:x1876532858545664:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 206us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601508.724114:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:1.0:1789601508.724869:0:8248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee008d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880556288:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601508.724896:0:8248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158acd6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.724908:0:8248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158acd6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.724914:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158acd6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601508.724933:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789601508.725507:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acd64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506135a expref: 56 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.725546:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158acd6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506135a expref: 55 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.725554:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:1.0:1789601508.725557:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789601508.725559:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee02166400, rc 0) 00000100:00100000:1.0:1789601508.725603:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:11618:x1876532858545536:12345-192.168.201.30@tcp:101:bash.0 Request processed in 7347us (7797us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1789601508.725611:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 206 00000100:00100000:2.0:1789601508.736033:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601508.736982:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858545920 00000100:00100000:0.0:1789601508.736995:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858545920 00000100:00100000:0.0:1789601508.737075:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 207 00000100:00100000:0.0:1789601508.737085:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+55:11618:x1876532858545920:12345-192.168.201.30@tcp:36:bash.0 00010000:00010000:0.0:1789601508.737356:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acd79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.737377:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acd79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.737389:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acd79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789601508.737443:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1789601508.737466:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ca9707a reply state 00000000b9f769bd transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acd79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601508.737475:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789601508.737576:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+58:11618:x1876532858545920:12345-192.168.201.30@tcp:36:bash.0 Request processed in 491us (1565us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1789601508.737583:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 207 00000020:00080000:0.0:1789601508.737588:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789601508.746096:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acd79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.746114:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acd79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.746122:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acd79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.746129:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601508.746135:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acd79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.746144:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acd79 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.746163:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:2.0:1789601508.746167:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601508.746172:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acd79 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.746177:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acd79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601508.748184:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601508.748261:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858546048 00000100:00100000:3.0:1789601508.748273:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858546048 00000100:00100000:3.0:1789601508.748333:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 208 00000100:00100000:3.0:1789601508.748345:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+57:11618:x1876532858546048:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789601508.748370:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601508.748391:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158acd80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061361 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.748495:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acd87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.748512:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158acd6b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506135a expref: 58 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.748521:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acd87 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.748557:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158acd6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506135a expref: 58 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.748571:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158acd6b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506135a expref: 58 pid: 8248 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601508.748584:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edfff53b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1876532880556416:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789601508.748712:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc46683c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601508.756510:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601508.756673:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edfff53b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1876532880556416:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601508.756704:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acd87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601508.757146:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858546176 00000100:00100000:2.0:1789601508.757155:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858546176 00010000:00010000:2.0:1789601508.757198:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158acd6b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506135a expref: 59 pid: 8248 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601508.757245:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:2.0:1789601508.757255:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00282a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+59:2356:x1876532858546176:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601508.757288:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601508.757296:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158acd6b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506135a expref: 59 pid: 8248 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.757307:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158acd6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506135a expref: 59 pid: 8248 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.757329:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158acd6b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506135a expref: 59 pid: 8248 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.757347:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:2.0:1789601508.757352:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acd87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.757372:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acd87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.757380:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acd87 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.757411:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601508.757460:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00282a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+58:2356:x1876532858546176:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 205us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601508.757467:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 80 00010000:00010000:1.0:1789601508.757616:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acd87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.757634:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acd87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601508.757681:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789601508.757686:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789601508.757708:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acd87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.757742:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158acd80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061361 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.757758:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acd87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061361 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.757773:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:1.0:1789601508.757776:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601508.757778:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc600, rc 0) 00000100:00100000:1.0:1789601508.757807:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+57:11618:x1876532858546048:12345-192.168.201.30@tcp:101:bash.0 Request processed in 9466us (9635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601508.757815:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 208 00000100:00100000:2.0:1789601508.772089:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601508.772819:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858546432 00000100:00100000:3.0:1789601508.772831:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858546432 00000100:00100000:3.0:1789601508.773063:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:3.0:1789601508.773075:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+57:11618:x1876532858546432:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:3.0:1789601508.773377:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+58:11618:x1876532858546432:12345-192.168.201.30@tcp:35:bash.0 Request processed in 303us (1296us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1789601508.773386:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 59 00000100:00100000:0.0:1789601508.893526:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601508.893731:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858546560 00000100:00100000:2.0:1789601508.893742:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858546560 00000100:00100000:2.0:1789601508.893804:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 209 00000100:00100000:2.0:1789601508.893815:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+58:11624:x1876532858546560:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789601508.893874:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601508.893896:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acd8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061368 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.893958:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acd95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.893971:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acd95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.894178:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acd95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601508.894226:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789601508.894231:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789601508.894309:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acd95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.894336:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acd8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061368 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.894355:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acd95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061368 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.894363:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:2.0:1789601508.894366:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789601508.894370:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8d400, rc 0) 00000100:00100000:2.0:1789601508.894959:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+59:11624:x1876532858546560:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1143us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601508.894968:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 209 00000100:00100000:0.0:1789601508.901659:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601508.901782:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858546688 00000100:00100000:1.0:1789601508.901793:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858546688 00000100:00100000:1.0:1789601508.902179:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 210 00000100:00100000:1.0:1789601508.902190:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+59:11624:x1876532858546688:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1789601508.902210:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601508.902232:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167400/0xf3d6e402158acd9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506136f expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902292:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158acda3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902308:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158acda3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902319:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158acda3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902334:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158acdaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902341:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158acdaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902366:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158acdaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902568:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902587:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902594:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601508.902632:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789601508.902636:0:8248:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789601508.902655:0:8248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902666:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902674:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158acda3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902681:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158acda3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902688:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158acda3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902693:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee02166200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601508.902698:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158acda3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902713:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158acda3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902725:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:1.0:1789601508.902728:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601508.902733:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158acda3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902739:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158acda3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902754:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158acdaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902760:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158acdaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902766:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158acdaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902771:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee02167c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601508.902774:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158acdaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902780:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158acdaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902787:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91edd35e8900) 00010000:00010000:1.0:1789601508.902790:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601508.902793:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158acdaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.902808:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158acdaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.903006:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167400/0xf3d6e402158acd9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506136f expref: 61 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.903032:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506136f expref: 60 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.903040:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:1.0:1789601508.903042:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601508.903045:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee02167e00, rc 0) 00000100:00100000:1.0:1789601508.903161:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+60:11624:x1876532858546688:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 971us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601508.903170:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 210 00000100:00100000:1.0:1789601508.908573:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601508.908669:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601508.908753:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858547072 00000100:00100000:0.0:1789601508.908764:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858547072 00000100:00100000:0.0:1789601508.908832:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 211 00000100:00100000:0.0:1789601508.908882:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+60:11624:x1876532858547072:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789601508.908903:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601508.908940:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158acdb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061376 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.909064:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acdbf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.909079:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acd87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061361 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.909087:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506136f expref: 61 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.909094:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acdbf lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.909127:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506136f expref: 61 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.909141:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506136f expref: 61 pid: 8248 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601508.909154:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc71a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1876532880556544:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789601508.909254:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acd87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061361 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601508.909263:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acd87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061361 expref: 61 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601508.909271:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc71a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1876532880556672:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789601508.909304:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc7343780 going to sleep for 11 seconds 00000100:00100000:3.0:1789601508.913367:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601508.913401:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858546816 00000100:00100000:3.0:1789601508.913425:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858546816 00010000:00010000:3.0:1789601508.913477:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdb1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506136f expref: 62 pid: 8248 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601508.913511:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858547200 00000100:00100000:3.0:1789601508.913515:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858547200 00010000:00010000:3.0:1789601508.913526:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acd87 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061361 expref: 63 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601508.913546:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:3.0:1789601508.913555:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+63:2359:x1876532858546816:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601508.913572:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601508.913578:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdb1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506136f expref: 63 pid: 8248 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.913590:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506136f expref: 63 pid: 8248 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.913612:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:3.0:1789601508.913618:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acdbf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.913628:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acdbf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.913636:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601508.913697:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+63:2359:x1876532858546816:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 142us (5135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601508.913704:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:3.0:1789601508.913730:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:3.0:1789601508.913736:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede51e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+62:2357:x1876532858547200:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601508.913757:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601508.913762:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acd87 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061361 expref: 62 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.913771:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acd87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061361 expref: 62 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.913781:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:3.0:1789601508.913785:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acdbf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.913791:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acdbf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.913799:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acdbf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.913827:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601508.914140:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede51e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+62:2357:x1876532858547200:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 135us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601508.914148:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 82 00010000:00010000:1.0:1789601508.914413:0:5839:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.30@tcp) returned -22 from blocking AST (req@00000000c07d82c7 x1876532880556544) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdb1 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506136f expref: 61 pid: 8248 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.914426:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506136f expref: 61 pid: 8248 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601508.914442:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc71a1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1876532880556544:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601508.914455:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acd87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061361 expref: 60 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601508.914479:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc71a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1876532880556672:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601508.914500:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:1.0:1789601508.914506:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acdbf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.914514:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acdbf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.914519:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acdbf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601508.914537:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789601508.914679:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925a00/0xf3d6e402158acdb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061376 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.914693:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acdbf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061376 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.914700:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:1.0:1789601508.914702:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789601508.914705:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00925600, rc 0) 00000100:00100000:1.0:1789601508.914740:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+60:11624:x1876532858547072:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 5871us (6070us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789601508.914747:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 211 00000100:00100000:3.0:1789601508.918151:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601508.918248:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858547456 00000100:00100000:2.0:1789601508.918258:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858547456 00000100:00100000:2.0:1789601508.918322:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:2.0:1789601508.918333:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+60:11624:x1876532858547456:12345-192.168.201.30@tcp:103:lfs.0 00010000:00010000:2.0:1789601508.918357:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601508.918380:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158acd1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506134c expref: 60 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601508.918402:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:2.0:1789601508.918407:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601508.918466:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+59:11624:x1876532858547456:12345-192.168.201.30@tcp:103:lfs.0 Request processed in 135us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601508.918475:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:3.0:1789601508.920677:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601508.920765:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858547584 00000100:00100000:1.0:1789601508.920774:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858547584 00000100:00100000:1.0:1789601508.920868:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 212 00000100:00100000:1.0:1789601508.920964:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+59:11624:x1876532858547584:12345-192.168.201.30@tcp:58:lfs.0 00010000:00010000:1.0:1789601508.921107:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdcd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.921125:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601508.921149:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789601508.921351:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789601508.921435:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+59:11624:x1876532858547584:12345-192.168.201.30@tcp:58:lfs.0 Request processed in 474us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601508.921443:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 212 00000100:00100000:1.0:1789601508.924496:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601508.924598:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858547712 00000100:00100000:3.0:1789601508.924610:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858547712 00000100:00100000:3.0:1789601508.924700:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 213 00000100:00100000:3.0:1789601508.924711:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+59:11624:x1876532858547712:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601508.924747:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601508.924770:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158acdd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506137d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.924901:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdcd lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.924912:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158acdd4 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506137d expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.924933:0:5837:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.924946:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158acdd4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506137d expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.924962:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:3.0:1789601508.924965:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789601508.924969:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158acdd4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506137d expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601508.924976:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadca00, rc 0) 00000100:00100000:3.0:1789601508.925050:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+60:11624:x1876532858547712:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 341us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601508.925058:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 213 00000100:00100000:0.0:1789601509.322882:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc71a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880557184:0@lo:400:kworker.0 00000100:00100000:0.0:1789601509.322962:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601509.323025:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc71a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880556928:0@lo:400:kworker.0 00000100:00100000:0.0:1789601509.323055:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789601509.323065:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc71a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880557056:0@lo:400:kworker.0 00000100:00100000:3.0:1789601509.323068:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601509.323107:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880557184 00000100:00100000:0.0:1789601509.323120:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880557184 00000100:00100000:2.0:1789601509.323153:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc71a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880556800:0@lo:400:kworker.0 00000100:00100000:0.0:1789601509.323184:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789601509.323194:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3320:x1876532880557184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601509.323222:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880556928 00000100:00100000:1.0:1789601509.323227:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880556928 00000100:00100000:1.0:1789601509.323258:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789601509.323265:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880556928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601509.336741:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601509.336796:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3320:x1876532880557184:12345-0@lo:400:kworker.0 Request processed in 13601us (13830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601509.336812:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789601509.336815:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc71a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880557312:0@lo:400:kworker.0 00000100:00100000:2.0:1789601509.336879:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601509.336924:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880557312 00000100:00100000:2.0:1789601509.336932:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880556800 00000100:00100000:0.0:1789601509.336934:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880557312 00000100:00100000:2.0:1789601509.336935:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880556800 00000100:00100000:2.0:1789601509.336972:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789601509.336981:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880556800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601509.337054:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880556800:12345-0@lo:400:kworker.0 Request processed in 74us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601509.337060:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789601509.337120:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc71a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880556800:0@lo:400:kworker.0 00000100:00100000:2.0:1789601509.337152:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789601509.337172:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880557312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601509.337211:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880557312:12345-0@lo:400:kworker.0 Request processed in 40us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601509.337218:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789601509.337245:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc71a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880557312:0@lo:400:kworker.0 00000100:00100000:2.0:1789601509.337277:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789601509.337283:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789601509.337288:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601509.337305:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc71a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880557184:0@lo:400:kworker.0 00000100:00100000:2.0:1789601509.337323:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880557056 00000100:00100000:2.0:1789601509.337326:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880557056 00000100:00100000:2.0:1789601509.337366:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789601509.337373:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880557056:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789601509.337376:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601509.337416:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880557056:12345-0@lo:400:kworker.0 Request processed in 43us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601509.337422:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789601509.337483:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc71a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880557056:0@lo:400:kworker.0 00000100:00100000:1.0:1789601509.337921:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880556928:12345-0@lo:400:kworker.0 Request processed in 14654us (14851us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601509.337928:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789601509.338851:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc71a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880556928:0@lo:400:kworker.0 00000100:00100000:3.0:1789601509.338862:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc71a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880557440:0@lo:400:kworker.0 00000100:00100000:3.0:1789601509.338903:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601509.339003:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880557440 00000100:00100000:0.0:1789601509.339019:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880557440 00000100:00100000:0.0:1789601509.339081:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789601509.339090:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1876532880557440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601509.339158:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1876532880557440:12345-0@lo:400:kworker.0 Request processed in 70us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601509.339165:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1789601509.341399:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601509.342135:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc71a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880557440:0@lo:400:kworker.0 00010000:00010000:1.0:1789601509.386197:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789601509.641220:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601509.641230:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601509.641272:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1789601509.641278:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789601509.641419:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee008d6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1876532880557568:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789601509.641526:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7ed4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789601509.644212:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee008d6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1876532880557568:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789601509.648673:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601509.658895:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858547840 00000100:00100000:2.0:1789601509.658912:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858547840 00000100:00100000:2.0:1789601509.659043:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 214 00000100:00100000:2.0:1789601509.659056:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+60:11625:x1876532858547840:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000100:00080000:3.0:1789601509.659244:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:2.0:1789601509.659371:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789601509.659489:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+60:11625:x1876532858547840:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 434us (10825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601509.659498:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 214 00000100:00100000:1.0:1789601509.664311:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601509.664496:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858547968 00000100:00100000:0.0:1789601509.664516:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858547968 00000100:00100000:0.0:1789601509.664570:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 215 00000100:00100000:0.0:1789601509.664579:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+60:11625:x1876532858547968:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789601509.664650:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924a00/0xf3d6e402158acddb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664666:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924a00/0xf3d6e402158acddb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664677:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924a00/0xf3d6e402158acddb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664690:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acde2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664705:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acde2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664712:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acde2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664738:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acde9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664746:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acde9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664752:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acde9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601509.664785:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789601509.664789:0:8248:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789601509.664808:0:8248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acde9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664818:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924a00/0xf3d6e402158acddb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664825:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924a00/0xf3d6e402158acddb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664832:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924a00/0xf3d6e402158acddb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664869:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924a00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601509.664874:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924a00/0xf3d6e402158acddb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664882:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924a00/0xf3d6e402158acddb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664893:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91edd35e8700) 00010000:00010000:0.0:1789601509.664896:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601509.664900:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924a00/0xf3d6e402158acddb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664906:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924a00/0xf3d6e402158acddb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664920:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acde2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664927:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acde2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664933:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acde2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664944:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601509.664947:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acde2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664953:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acde2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664961:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff91edd0646600) 00010000:00010000:0.0:1789601509.664963:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601509.664965:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acde2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664971:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acde2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664986:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acde9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664992:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acde9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.664997:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acde9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.665015:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601509.665018:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acde9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.665023:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acde9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.666893:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:0.0:1789601509.666896:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601509.666903:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acde9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.666911:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925200/0xf3d6e402158acde9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601509.672232:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+60:11625:x1876532858547968:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 Request processed in 2447us (2724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601509.672262:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 215 00000100:00100000:3.0:1789601509.678269:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601509.678913:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858548224 00000100:00100000:2.0:1789601509.678926:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858548224 00000100:00100000:2.0:1789601509.678996:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 216 00000100:00100000:2.0:1789601509.679017:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+60:11625:x1876532858548224:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601509.679072:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601509.679095:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acdf0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061384 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.679532:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acdf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.679547:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acdf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.679559:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acdf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601509.679572:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789601509.679689:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acdf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.679698:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acdf7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.680476:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acdf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.680482:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601509.680487:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acdf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.680496:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acdf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.680511:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:2.0:1789601509.680527:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789601509.680533:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acdf7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.680539:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158acdf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.680592:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acdf0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061384 expref: 62 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.680603:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91edd35e8700) 00010000:00010000:2.0:1789601509.680605:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789601509.680609:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158acdf0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061384 expref: 62 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.680619:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8cc00, rc 0) 00000100:00100000:2.0:1789601509.680708:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+61:11625:x1876532858548224:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 1684us (2439us total) trans 4294967504 rc 301/301 00000100:00100000:2.0:1789601509.680717:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 216 00000100:00100000:3.0:1789601509.688545:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601509.688638:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858548352 00000100:00100000:2.0:1789601509.688650:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858548352 00000100:00100000:2.0:1789601509.688720:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 217 00000100:00100000:2.0:1789601509.688736:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+61:11625:x1876532858548352:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789601509.688772:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789601509.688900:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+61:11625:x1876532858548352:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 170us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601509.688907:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 217 00000100:00100000:1.0:1789601509.698502:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601509.698768:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858548608 00000100:00100000:3.0:1789601509.698779:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858548608 00000100:00100000:2.0:1789601509.699207:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 218 00000100:00100000:2.0:1789601509.699240:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+61:11625:x1876532858548608:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601509.699262:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601509.699265:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789601509.699293:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158acd95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061368 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.699315:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:2.0:1789601509.699321:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601509.699335:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ace05 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506138b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789601509.699737:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1789601509.700708:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.700728:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.700742:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.700865:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ace05 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506138b expref: 63 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.700887:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506138b expref: 62 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.700896:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91edd8ce5500) 00010000:00010000:3.0:1789601509.700899:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601509.700902:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc400, rc 0) 00000100:00100000:3.0:1789601509.701413:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+62:11625:x1876532858548608:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 2176us (2920us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1789601509.701435:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 218 00000100:00100000:0.0:1789601509.708748:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601509.708936:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858548864 00000100:00100000:2.0:1789601509.708947:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858548864 00000100:00100000:2.0:1789601509.709016:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 219 00000100:00100000:2.0:1789601509.709028:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+62:11625:x1876532858548864:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789601509.709093:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601509.709121:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506138b expref: 62 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709142:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91edd8ce5500) 00010000:00010000:2.0:1789601509.709155:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601509.709176:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158ace1a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709192:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158ace1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709223:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158ace1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709238:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x641f2509 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709245:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x641f2509 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709251:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x641f2509 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709313:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158ace1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709320:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158ace1a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709327:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158ace1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709334:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d400 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601509.709338:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158ace1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709346:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158ace1a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709354:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:2.0:1789601509.709357:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601509.709361:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158ace1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709374:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d400/0xf3d6e402158ace1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709383:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x641f2509 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709388:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x641f2509 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709393:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x641f2509 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709397:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601509.709400:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x641f2509 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709405:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace21 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x641f2509 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709413:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x641f2509 (ffff91edd8a67100) 00010000:00010000:2.0:1789601509.709415:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601509.709418:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace21 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x641f2509 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.709422:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x641f2509 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601509.709517:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+61:11625:x1876532858548864:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 491us (778us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789601509.709524:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 219 00000100:00100000:3.0:1789601509.721950:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601509.722261:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858548992 00000100:00100000:1.0:1789601509.722273:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858548992 00000100:00100000:1.0:1789601509.722332:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 220 00000100:00100000:1.0:1789601509.722342:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+61:11625:x1876532858548992:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601509.722364:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601509.722397:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158ace28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061392 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.722436:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158ace2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.722449:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158ace2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.722461:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158ace2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.722562:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158ace28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061392 expref: 63 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.722582:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158ace2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061392 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.722591:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91edd35e8900) 00010000:00010000:1.0:1789601509.722594:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789601509.722606:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee02167c00, rc 0) 00000100:00100000:1.0:1789601509.722667:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+62:11625:x1876532858548992:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 326us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601509.722673:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 220 00000100:00100000:3.0:1789601509.725267:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601509.725369:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858549248 00000100:00100000:2.0:1789601509.725384:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858549248 00000100:00100000:2.0:1789601509.725446:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 221 00000100:00100000:2.0:1789601509.725456:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+62:11625:x1876532858549248:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789601509.725545:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.725562:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.725573:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789601509.725876:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1789601509.725888:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379764050585ns, next at 380764047652ns, rc = 0 00000004:00010000:2.0:1789601509.725973:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce17d2ec reply state 00000000747cfc59 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601509.725981:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789601509.726304:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+64:11625:x1876532858549248:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 848us (1045us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789601509.726312:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 221 00010000:00010000:1.0:1789601509.732819:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.732873:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.732882:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.732889:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601509.732894:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.732902:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.732919:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91edd35e8900) 00010000:00010000:1.0:1789601509.732922:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789601509.732927:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.732933:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d200/0xf3d6e402158ace36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601509.735826:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601509.736341:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858549376 00000100:00100000:1.0:1789601509.736357:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858549376 00000100:00100000:1.0:1789601509.736428:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 222 00000100:00100000:1.0:1789601509.736443:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+63:11625:x1876532858549376:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601509.736483:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601509.736504:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158ace3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061399 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.736563:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158ace3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061399 expref: 64 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.736579:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158ace3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061399 expref: 64 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.736597:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91edd35e8900) 00010000:00010000:1.0:1789601509.736600:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789601509.736604:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee02166200, rc 0) 00000100:00100000:1.0:1789601509.736677:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+64:11625:x1876532858549376:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 240us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601509.736683:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 222 00000100:00100000:0.0:1789601509.742226:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601509.743818:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858549504 00000100:00100000:2.0:1789601509.743858:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858549504 00000100:00100000:2.0:1789601509.743954:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00080000:3.0:1789601509.743969:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601509.743980:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:2356:x1876532858549504:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789601509.744314:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+10:2356:x1876532858549504:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 351us (2103us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1789601509.744322:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:0.0:1789601509.749616:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601509.749701:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858549760 00000100:00100000:1.0:1789601509.749717:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858549760 00000100:00100000:1.0:1789601509.749789:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:1.0:1789601509.749798:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+64:11625:x1876532858549760:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789601509.750295:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+65:11625:x1876532858549760:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 496us (696us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789601509.750303:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 60 00000100:00100000:3.0:1789601509.763467:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601509.764788:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858550016 00000100:00100000:1.0:1789601509.764805:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858550016 00000100:00100000:1.0:1789601509.764949:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 223 00000100:00100000:1.0:1789601509.764962:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+65:11625:x1876532858550016:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789601509.765509:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+65:11625:x1876532858550016:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 548us (2059us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601509.765518:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 223 00000100:00100000:0.0:1789601509.768704:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601509.770130:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858550144 00000100:00100000:1.0:1789601509.770146:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858550144 00000100:00100000:1.0:1789601509.770220:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 224 00000100:00100000:1.0:1789601509.770231:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+65:11625:x1876532858550144:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601509.770254:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601509.770278:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167400/0xf3d6e402158ace44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50613a0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.770350:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158ace4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.770367:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158ace4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.770379:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158ace4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601509.770419:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789601509.770438:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158ace4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.770463:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167400/0xf3d6e402158ace44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613a0 expref: 67 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.770483:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158ace4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613a0 expref: 66 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601509.770492:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91edd35e8900) 00010000:00010000:1.0:1789601509.770495:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789601509.770512:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee02166400, rc 0) 00000100:00100000:1.0:1789601509.770577:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+66:11625:x1876532858550144:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 347us (1897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601509.770583:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 224 00000100:00100000:3.0:1789601509.775101:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601509.779018:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858550272 00000100:00100000:0.0:1789601509.779047:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858550272 00000100:00100000:0.0:1789601509.779189:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:0.0:1789601509.779203:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+10:2356:x1876532858550272:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601509.779227:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601509.779257:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c087f21/0xf3d6e402158ace52 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50613a7 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789601509.779295:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab26e6, blocks: 0x1 00010000:00010000:0.0:1789601509.779349:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1789601509.779355:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601509.779367:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c087f21/0xf3d6e402158ace52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613a7 expref: 11 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.779389:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000c087f21/0xf3d6e402158ace52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613a7 expref: 11 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.779404:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00925000, rc 0) 00000100:00100000:0.0:1789601509.779712:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+11:2356:x1876532858550272:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 509us (4623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601509.779720:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:3.0:1789601509.782942:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601509.783211:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858550528 00000100:00100000:2.0:1789601509.783226:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858550528 00000100:00100000:2.0:1789601509.783304:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 225 00000100:00100000:2.0:1789601509.783317:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+66:11625:x1876532858550528:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789601509.783594:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+66:11625:x1876532858550528:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 277us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601509.783603:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 225 00000100:00100000:3.0:1789601509.788621:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601509.789024:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858550656 00000100:00100000:0.0:1789601509.789041:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858550656 00000100:00100000:0.0:1789601509.789399:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:0.0:1789601509.789412:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+11:11625:x1876532858550656:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601509.789437:0:11670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601509.789459:0:11670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ace59 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50613ae expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.789499:0:11670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000c087f21/0xf3d6e402158ace52 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613a7 expref: 12 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.789509:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601509.789515:0:11670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601509.789521:0:11670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ace59 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613ae expref: 12 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.789582:0:11670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000c087f21/0xf3d6e402158ace52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613a7 expref: 12 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.789597:0:11670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000c087f21/0xf3d6e402158ace52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613a7 expref: 12 pid: 6677 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601509.789614:0:11670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc71a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11670:1876532880557696:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789601509.789787:0:11670:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc73439c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601509.793055:0:11670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc71a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11670:1876532880557696:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789601509.793125:0:11670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ace59 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613ae expref: 12 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.793159:0:11670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924400, rc 0) 00000100:00100000:2.0:1789601509.793430:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+12:11625:x1876532858550656:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 4011us (4814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601509.793442:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:3.0:1789601509.795575:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601509.795714:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858550784 00000100:00100000:0.0:1789601509.795729:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858550784 00010000:00010000:0.0:1789601509.795787:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000c087f21/0xf3d6e402158ace52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613a7 expref: 12 pid: 6677 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601509.795917:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 83 00000100:00100000:0.0:1789601509.795929:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+12:2356:x1876532858550784:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601509.795949:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601509.795981:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000c087f21/0xf3d6e402158ace52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613a7 expref: 12 pid: 6677 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.796008:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000c087f21/0xf3d6e402158ace52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613a7 expref: 12 pid: 6677 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.796038:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c087f21/0xf3d6e402158ace52 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613a7 expref: 12 pid: 6677 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.796300:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601509.796306:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601509.796318:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ace59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613ae expref: 11 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.796330:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ace59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613ae expref: 11 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.796385:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ace59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613ae expref: 11 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601509.796416:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc71a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5823:1876532880557824:192.168.201.30@tcp:105: 00000100:00100000:0.0:1789601509.796536:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc73436c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601509.807501:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc71a0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5823:1876532880557824:192.168.201.30@tcp:105: 00010000:00010000:0.0:1789601509.807546:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601509.807639:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+11:2356:x1876532858550784:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 11710us (12076us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601509.807651:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 83 00000100:00100000:1.0:1789601509.811349:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601509.812813:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858550912 00000100:00100000:2.0:1789601509.812833:0:6684:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858550912 00002000:00100000:2.0:1789601509.813215:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff91ee008d6a00 x1876532858550912/t0(0) o4->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:105/0 lens 504/0 e 0 to 0 dl 1789601520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789601509.813229:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91ee008d6a00 with x1876532858550912 ext(0->12) 00002000:00010000:2.0:1789601509.813237:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91ee008d6a00 00000100:00100000:2.0:1789601509.813350:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:2.0:1789601509.813362:0:6684:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+11:2356:x1876532858550912:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789601509.814656:0:6684:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:2356:x1876532858550912:12345-192.168.201.30@tcp:4:lhsmtool_posix.0 Request processed in 1289us (3316us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1789601509.814798:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00002000:00100000:2.0:1789601509.814811:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff91ee008d6a00 x1876532858550912/t4294967320(0) o4->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:105/0 lens 504/448 e 0 to 0 dl 1789601520 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789601509.814823:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91ee008d6a00 with x1876532858550912 ext(0->12) 00002000:00010000:2.0:1789601509.814829:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91ee008d6a00 00000100:00100000:3.0:1789601509.824338:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601509.824500:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858551040 00000100:00100000:0.0:1789601509.824517:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858551040 00000100:00100000:0.0:1789601509.824607:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 226 00000100:00100000:0.0:1789601509.824622:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+66:11625:x1876532858551040:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789601509.834454:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880557952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601509.834561:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601509.834653:0:10225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880557952 00000100:00100000:1.0:1789601509.834666:0:10225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880557952 00000100:00100000:1.0:1789601509.834731:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789601509.834744:0:10225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1876532880557952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601509.834775:0:10225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601509.834833:0:10225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1876532880557952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601509.834866:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789601509.834933:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880557952:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1789601509.895894:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000100:00100000:3.0:1789601509.895904:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+66:11625:x1876532858551040:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 Request processed in 71272us (71570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601509.895917:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 226 00000001:00080000:2.0:1789601509.895924:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:2.0:1789601509.895979:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000004:00080000:2.0:1789601509.896025:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:2.0:1789601509.896066:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789601509.896085:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91ede9e69300 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1789601509.896090:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91edf7ed6f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91ede9e69600 00000020:00080000:2.0:1789601509.896093:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91edf7ed6600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91edf892f400 00000020:00080000:2.0:1789601509.896113:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91edffe64180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1789601509.896116:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91edf7ed6300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91edffe64a80 00000020:00080000:2.0:1789601509.896119:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91edf7ed6c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91edf8687800 00000100:00100000:3.0:1789601509.896215:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf83bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880558080:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789601509.896294:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1789601509.896375:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:3.0:1789601509.896376:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf83bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880558208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789601509.896402:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601509.896617:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601509.896620:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880558080 00000100:00100000:3.0:1789601509.896624:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880558336:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789601509.896630:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880558080 00000100:00100000:3.0:1789601509.896649:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601509.896678:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880558208 00000100:00100000:3.0:1789601509.896682:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880558208 00000100:00100000:0.0:1789601509.896707:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880558336 00000100:00100000:0.0:1789601509.896711:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880558336 00000100:00100000:3.0:1789601509.897237:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789601509.897250:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3320:x1876532880558080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789601509.897289:0:6676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1789601509.897334:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.897362:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007819e969/0xf3d6e402158acc22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506130d expref: 12 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.897373:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789601509.897378:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789601509.897384:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace60 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789601509.897473:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:3.0:1789601509.897502:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007819e969/0xf3d6e402158acc22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506130d expref: 12 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.897522:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007819e969/0xf3d6e402158acc22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506130d expref: 12 pid: 11670 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601509.897538:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf83bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876532880558464:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789601509.897687:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc4668540 going to sleep for 11 seconds 00000100:00100000:3.0:1789601509.897716:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789601509.897727:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3317:x1876532880558208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789601509.897937:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789601509.897941:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789601510 00002000:00010000:3.0:1789601509.897944:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789601509.897946:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789601510 -> 1789601510 00002000:00010000:3.0:1789601509.897949:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789601509.898048:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3317:x1876532880558208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 323us (1644us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1789601509.898056:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789601509.898080:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789601509.898099:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3317:x1876532880558336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789601509.898123:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1789601509.898156:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aab26e5, atime: 0x6aab26e5, ctime: 0x6aab26e5, blocks: 0x1 00010000:00010000:3.0:1789601509.898163:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0a19de/0xf3d6e402158ace67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.898175:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1789601509.898179:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601509.898186:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e0a19de/0xf3d6e402158ace67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.898206:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e0a19de/0xf3d6e402158ace67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.898217:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0a19de/0xf3d6e402158ace67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.898225:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e0a19de/0xf3d6e402158ace67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.898250:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789601509.898826:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3317:x1876532880558336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 738us (2172us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789601509.898893:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:3.0:1789601509.898935:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601509.898943:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e0a19de/0xf3d6e402158ace67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.898955:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadce00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601509.898961:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0a19de/0xf3d6e402158ace67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.898971:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0a19de/0xf3d6e402158ace67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.899006:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e0a19de/0xf3d6e402158ace67 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.899013:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e0a19de/0xf3d6e402158ace67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.899042:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601509.899044:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601509.899046:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789601509.900987:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91ee00660380/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789601509.901019:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880558336:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1789601509.901039:0:3317:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91edf83bdc00/2, rc 0, transno 4294967321 00000100:00100000:2.0:1789601509.901045:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf83bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880558208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789601509.905561:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601509.905635:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858551168 00000100:00100000:2.0:1789601509.905670:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858551168 00000100:00100000:2.0:1789601509.905754:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:2.0:1789601509.905777:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:2357:x1876532858551168:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789601509.918779:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601509.918826:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858551296 00000100:00100000:0.0:1789601509.918859:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858551296 00010000:00010000:0.0:1789601509.918909:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007819e969/0xf3d6e402158acc22 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506130d expref: 14 pid: 11670 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601509.918953:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:0.0:1789601509.918964:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+14:2356:x1876532858551296:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601509.918984:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601509.918991:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007819e969/0xf3d6e402158acc22 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506130d expref: 14 pid: 11670 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.919025:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007819e969/0xf3d6e402158acc22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506130d expref: 14 pid: 11670 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.919058:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789601509.919063:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789601509.919070:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.919511:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007819e969/0xf3d6e402158acc22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506130d expref: 14 pid: 11670 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601509.919528:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace60 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601509.919534:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf83bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876532880558464:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789601509.919556:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601509.919562:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.919587:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.919594:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.919605:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.919612:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601509.919623:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+13:2356:x1876532858551296:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 661us (861us total) trans 0 rc 0/0 00010000:00010000:3.0:1789601509.919634:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789601509.919648:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:3.0:1789601509.920470:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3320:x1876532880558080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23219us (24170us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789601509.920481:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1789601509.920512:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601509.920521:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.920534:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc200 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601509.920540:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.920552:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.920580:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace60 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.920589:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601509.920613:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601509.920616:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601509.920617:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789601509.920658:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91edf83bed80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1789601509.920667:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf83bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880558080:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1789601509.989254:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:2.0:1789601509.989279:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1789601509.989286:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:2.0:1789601509.989305:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1789601509.989598:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2357:x1876532858551168:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 Request processed in 83815us (84047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601509.989612:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:0.0:1789601509.998572:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601509.998746:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858551552 00000100:00100000:2.0:1789601509.998760:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858551552 00000100:00100000:2.0:1789601509.998883:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 227 00000100:00100000:2.0:1789601509.998895:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:11625:x1876532858551552:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789601509.998976:0:8248:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601509.999025:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166400/0xf3d6e402158ace4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613a0 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.999052:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91edd35e8900) 00010000:00010000:2.0:1789601509.999059:0:8248:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601509.999101:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ace6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.999319:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ace6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601509.999333:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ace6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601510.006565:0:8248:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d53b301b reply state 00000000f368a859 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ace6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601510.006593:0:8248:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789601510.006826:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:11625:x1876532858551552:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 7927us (8263us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789601510.006863:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 227 00000100:00100000:2.0:1789601510.019163:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601510.019920:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858551680 00000100:00100000:0.0:1789601510.019935:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858551680 00000100:00100000:0.0:1789601510.020035:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:0.0:1789601510.020048:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2356:x1876532858551680:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789601510.020366:0:6679:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789601510.020371:0:6679:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789601510 -> 1789601509 00002000:00010000:0.0:1789601510.020374:0:6679:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789601509 00002000:00010000:0.0:1789601510.020376:0:6679:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789601510 -> 1789601509 00002000:00010000:0.0:1789601510.020379:0:6679:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789601510.020482:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2356:x1876532858551680:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 436us (1335us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789601510.020491:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00010000:00010000:3.0:1789601510.029788:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ace6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.029815:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ace6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.029889:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ace6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.029895:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601510.029902:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ace6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.029911:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ace6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.029935:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91edd35e8900) 00010000:00010000:3.0:1789601510.029938:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601510.029944:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ace6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.029951:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d000/0xf3d6e402158ace6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601510.038500:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601510.038658:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858551936 00000100:00100000:1.0:1789601510.038674:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858551936 00000100:00100000:1.0:1789601510.038758:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 228 00000100:00100000:1.0:1789601510.038772:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:11625:x1876532858551936:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789601510.038895:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ace75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601510.038916:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158ace2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061392 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601510.038948:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ace75 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601510.039005:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158ace2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061392 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601510.039021:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158ace2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061392 expref: 20 pid: 5838 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601510.039038:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee008d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1876532880558592:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789601510.039301:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7ed4180 going to sleep for 11 seconds 00000100:00100000:1.0:1789601510.044975:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee008d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1876532880558592:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601510.045032:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ace75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601510.045933:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601510.046456:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858552064 00000100:00100000:3.0:1789601510.046651:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858552064 00010000:00010000:3.0:1789601510.046718:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158ace2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061392 expref: 21 pid: 5838 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601510.046818:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 85 00000100:00100000:3.0:1789601510.046831:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00663b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:2357:x1876532858552064:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601510.046882:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601510.046891:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158ace2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061392 expref: 21 pid: 5838 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.046925:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158ace2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061392 expref: 21 pid: 5838 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.046957:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167c00/0xf3d6e402158ace2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061392 expref: 21 pid: 5838 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.046978:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91edd35e8900) 00010000:00010000:3.0:1789601510.046984:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ace75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.047009:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ace75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.047018:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ace75 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.047061:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601510.047161:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00663b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:2357:x1876532858552064:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 333us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601510.047169:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 85 00010000:00010000:1.0:1789601510.047877:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ace75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601510.047891:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ace75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601510.047930:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ace75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601510.047938:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ace75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601510.047946:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ace75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601510.047967:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601510.047973:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ace75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601510.047982:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ace75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601510.048007:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91edd35e8900) 00010000:00010000:1.0:1789601510.048010:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789601510.048015:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ace75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601510.048021:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158ace75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601510.048126:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:11625:x1876532858551936:12345-192.168.201.30@tcp:55:lhsmtool_posix.0 Request processed in 9355us (9639us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789601510.048136:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 228 00000100:00100000:2.0:1789601510.051375:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601510.051739:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858552192 00000100:00100000:3.0:1789601510.051754:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858552192 00000100:00100000:3.0:1789601510.051921:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:3.0:1789601510.051934:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2356:x1876532858552192:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789601510.052013:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace7c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.052067:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ace59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613ae expref: 8 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.052079:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789601510.052084:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789601510.052090:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace7c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.052152:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ace59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613ae expref: 8 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.052169:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ace59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613ae expref: 8 pid: 11670 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601510.052190:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf83bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876532880558720:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789601510.052299:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8dbf840 going to sleep for 11 seconds 00000100:00100000:2.0:1789601510.055183:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601510.055554:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf83bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1876532880558720:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601510.055595:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace7c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601510.055745:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858552320 00000100:00100000:0.0:1789601510.055755:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858552320 00010000:00010000:0.0:1789601510.055803:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ace59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613ae expref: 9 pid: 11670 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601510.055982:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:0.0:1789601510.056006:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00661880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+9:2356:x1876532858552320:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601510.056026:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601510.056060:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ace59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613ae expref: 9 pid: 11670 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601510.056100:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ace59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613ae expref: 9 pid: 11670 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601510.056134:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051df646b/0xf3d6e402158ace59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613ae expref: 9 pid: 11670 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601510.056157:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789601510.056162:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789601510.056169:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace7c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601510.056181:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace7c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601510.056219:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601510.056339:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace7c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.056349:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace7c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.056389:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace7c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.056398:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace7c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.056407:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.056415:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc200 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601510.056420:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.056431:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.056443:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.056451:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ace7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601510.056648:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00661880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2356:x1876532858552320:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 653us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601510.056657:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:3.0:1789601510.056733:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00661c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2356:x1876532858552192:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 Request processed in 4802us (5373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601510.056743:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 70 00000100:00100000:0.0:1789601510.060723:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601510.060813:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858552576 00000100:00100000:3.0:1789601510.060828:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858552576 00000100:00100000:3.0:1789601510.060950:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 229 00000100:00100000:3.0:1789601510.060963:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:11625:x1876532858552576:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789601510.061450:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.061487:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.061503:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.061815:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace8a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.061830:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158ace3d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061399 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.061879:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace8a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.061935:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158ace3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061399 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.061954:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158ace3d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061399 expref: 20 pid: 5838 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601510.061971:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf83bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1876532880558848:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789601510.069195:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8dbf840 going to sleep for 11 seconds 00000100:00100000:1.0:1789601510.073565:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601510.073797:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf83bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1876532880558848:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789601510.073890:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace8a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601510.074029:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858552704 00000100:00100000:0.0:1789601510.074041:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858552704 00010000:00010000:0.0:1789601510.074094:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158ace3d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061399 expref: 21 pid: 5838 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601510.074149:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 87 00000100:00100000:0.0:1789601510.074161:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:2356:x1876532858552704:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601510.074201:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601510.074210:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158ace3d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061399 expref: 21 pid: 5838 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601510.074225:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158ace3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061399 expref: 21 pid: 5838 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601510.074253:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02166200/0xf3d6e402158ace3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061399 expref: 21 pid: 5838 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601510.074274:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91edd35e8900) 00010000:00010000:0.0:1789601510.074280:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace8a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601510.074292:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601510.074301:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace8a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601510.074328:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601510.074395:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:2356:x1876532858552704:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 235us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601510.074403:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 87 00010000:00010000:1.0:1789601510.074609:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601510.074617:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789601510.074919:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1789601510.075124:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1789601510.075172:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1789601510.075281:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee008d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1876532880558976:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789601510.075371:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601510.075421:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7ed4900 going to sleep for 11 seconds 00000100:00100000:2.0:1789601510.076257:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880558976 00000100:00100000:2.0:1789601510.076269:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880558976 00000100:00100000:2.0:1789601510.076333:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789601510.076343:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1876532880558976:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789601510.076637:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1876532880558976:12345-0@lo:1000:mdt00_000.0 Request processed in 294us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601510.076645:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789601510.076798:0:5837:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1789601510.076815:0:5837:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1789601510.076885:0:5837:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91edf83bdc00, transno 4294967321 00000100:00100000:3.0:1789601510.076905:0:5837:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff91edf83bed80 x1876532880558080/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789601525 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601510.076924:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee008d7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1876532880558976:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789601510.077827:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1789601510.077971:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf83bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1876532880559104:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789601510.078059:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601510.078105:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8dbf840 going to sleep for 11 seconds 00000100:00100000:2.0:1789601510.078124:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880559104 00000100:00100000:2.0:1789601510.078133:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880559104 00000100:00100000:2.0:1789601510.078358:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789601510.078368:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1876532880559104:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789601510.078907:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5837:x1876532880559104:12345-0@lo:1000:mdt00_000.0 Request processed in 539us (846us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789601510.078915:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789601510.078968:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf83bce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5837:1876532880559104:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789601510.079174:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.079186:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace8a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.079195:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace8a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.079202:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc400 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601510.079207:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace8a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.079217:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace8a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.079236:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91edd35e8900) 00010000:00010000:3.0:1789601510.079240:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789601510.079246:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace8a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.079261:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158ace8a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.079375:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdcd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.079382:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdcd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.079388:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdcd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.079393:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee02167e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601510.079396:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdcd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.079401:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdcd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.079411:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:3.0:1789601510.079413:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789601510.079422:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158acdd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506137d expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.079437:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158acdd4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506137d expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.079447:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158acdd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506137d expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.079499:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158acdd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506137d expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601510.079516:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf83bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1876532880559232:192.168.201.30@tcp:105: 00000100:00100000:3.0:1789601510.079605:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8dbf840 going to sleep for 11 seconds 00000100:00100000:1.0:1789601510.084430:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601510.085369:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf83bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1876532880559232:192.168.201.30@tcp:105: 00010000:00010000:3.0:1789601510.085414:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdcd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.085428:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee02167e00/0xf3d6e402158acdcd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.085476:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ace91 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.085496:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ace91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.085510:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ace91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.085523:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ace91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.085529:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ace91 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.085536:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ace91 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.085565:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601510.085570:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ace91 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.085579:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ace91 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.085595:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:3.0:1789601510.085598:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601510.085603:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ace91 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.085609:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ace91 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.085621:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.085627:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.085633:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.085638:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadce00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601510.085641:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.085647:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.085667:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:3.0:1789601510.085669:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789601510.085672:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.085678:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601510.086061:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+23:11625:x1876532858552576:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 25091us (25346us total) trans 4294967513 rc 0/0 00000100:00100000:3.0:1789601510.086075:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 229 00000020:00080000:3.0:1789601510.086084:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789601510.086488:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601510.086496:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601510.087264:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789601510.087278:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789601510.088436:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858552832 00000100:00100000:0.0:1789601510.088456:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858552832 00000100:00100000:1.0:1789601510.088671:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:1.0:1789601510.088684:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+23:11624:x1876532858552832:12345-192.168.201.30@tcp:49:lfs.0 00000100:00100000:1.0:1789601510.089301:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+23:11624:x1876532858552832:12345-192.168.201.30@tcp:49:lfs.0 Request processed in 615us (4883us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601510.089311:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 61 00000100:00100000:1.0:1789601510.096512:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601510.096643:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858553088 00000100:00100000:3.0:1789601510.096671:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858553088 00000100:00100000:3.0:1789601510.096792:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 230 00000100:00100000:3.0:1789601510.096806:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+23:11624:x1876532858553088:12345-192.168.201.30@tcp:58:lfs.0 00000040:00080000:3.0:1789601510.097789:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1789601510.098651:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+23:11624:x1876532858553088:12345-192.168.201.30@tcp:58:lfs.0 Request processed in 1840us (2146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601510.098667:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 230 00000100:00100000:1.0:1789601510.099399:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601510.099627:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858553344 00000100:00100000:3.0:1789601510.099639:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858553344 00000100:00100000:3.0:1789601510.099774:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 62 00000100:00100000:3.0:1789601510.099789:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91eddcdaf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+23:11625:x1876532858553344:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789601510.101617:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789601510.102619:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:3.0:1789601510.102820:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.102897:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.102915:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.102928:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace98 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.102935:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace98 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.102942:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.102972:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601510.103281:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601510.103291:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601510.103299:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadce00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601510.103304:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601510.103326:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601510.103341:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91edd8ce5700) 00010000:00010000:2.0:1789601510.103345:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789601510.103351:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace98 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601510.103357:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158ace98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601510.103381:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601510.103383:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601510.103385:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601510.103649:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91eddcdaf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+25:11625:x1876532858553344:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 3858us (4247us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1789601510.103673:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 62 00000020:00080000:3.0:1789601510.103680:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789601510.131023:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601510.131574:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858553472 00000100:00100000:3.0:1789601510.131590:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858553472 00000100:00100000:3.0:1789601510.131673:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 231 00000100:00100000:3.0:1789601510.131685:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+25:11627:x1876532858553472:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601510.131719:0:8248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601510.131747:0:8248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ace9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50613b5 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.131831:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158acea6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.131906:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158acea6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.131922:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158acea6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.131940:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acead lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.131947:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.131955:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.132648:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158aceb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.132664:0:8248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acdbf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061376 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.132674:0:8248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158aceb4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.132720:0:8248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acdbf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061376 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.132739:0:8248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acdbf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061376 expref: 26 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601510.132771:0:8248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf83bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880559360:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789601510.133724:0:8248:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8dbf480 going to sleep for 11 seconds 00000100:00100000:3.0:1789601510.136689:0:8248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf83bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8248:1876532880559360:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601510.136747:0:8248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158aceb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601510.139954:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601510.140473:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858553728 00000100:00100000:1.0:1789601510.140491:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858553728 00000100:00100000:1.0:1789601510.140568:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:1.0:1789601510.140582:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+27:5597:x1876532858553728:12345-192.168.201.30@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789601510.141001:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+28:5597:x1876532858553728:12345-192.168.201.30@tcp:35:ldlm_bl.0 Request processed in 412us (1055us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1789601510.141011:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 63 00000100:00100000:1.0:1789601510.145514:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601510.145634:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858553856 00000100:00100000:2.0:1789601510.145649:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858553856 00010000:00010000:2.0:1789601510.145703:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acdbf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061376 expref: 28 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601510.145755:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 88 00000100:00100000:2.0:1789601510.145767:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede51e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+28:2357:x1876532858553856:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601510.145790:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601510.145798:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acdbf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061376 expref: 28 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601510.145813:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acdbf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061376 expref: 28 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601510.145874:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925600/0xf3d6e402158acdbf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061376 expref: 28 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601510.145915:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:2.0:1789601510.145922:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158aceb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601510.145934:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158aceb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601510.145943:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158aceb4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601510.145983:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601510.146752:0:8248:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158aceb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.146765:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158aceb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601510.146828:0:8248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789601510.146833:0:8248:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789601510.146884:0:8248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158aceb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.146901:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158aceb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.146913:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158acea6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.146921:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158acea6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.146929:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158acea6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.146937:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc400 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601510.146956:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158acea6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.146966:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158acea6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.146979:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:3.0:1789601510.146982:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601510.146986:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158acea6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.147003:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc400/0xf3d6e402158acea6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.147018:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acead lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.147024:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acead lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.147030:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.147035:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601510.147038:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.147044:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acead lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.147922:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91edd8ce5100) 00010000:00010000:3.0:1789601510.147926:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601510.147944:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acead lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.147951:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc600/0xf3d6e402158acead lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.148031:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc200/0xf3d6e402158ace9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613b5 expref: 28 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601510.148048:0:8248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158aceb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613b5 expref: 27 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601510.149528:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede51e1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+27:2357:x1876532858553856:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 3746us (4016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601510.149546:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 88 00010000:00010000:3.0:1789601510.149791:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:3.0:1789601510.149795:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789601510.149798:0:8248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadce00, rc 0) 00000100:00100000:3.0:1789601510.149879:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+26:11627:x1876532858553472:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 18197us (18873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601510.149887:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 231 00010000:00010000:3.0:1789601510.410153:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789601510.900511:0:12598:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789601510.900520:0:12598:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789601510.900569:0:12598:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789601510.900575:0:12598:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789601511.113167:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601511.113178:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601511.113219:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789601511.113225:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789601511.113373:0:11667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee008d7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1876532880559488:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789601511.113483:0:11667:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc73439c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789601511.116881:0:11667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee008d7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11667:1876532880559488:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789601511.121471:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601511.121548:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858553984 00000100:00100000:1.0:1789601511.121558:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858553984 00000100:00100000:1.0:1789601511.121632:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 232 00000100:00100000:1.0:1789601511.121643:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+26:11639:x1876532858553984:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789601511.121674:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789601511.121771:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+26:11639:x1876532858553984:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 131us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601511.121776:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 232 00000100:00080000:3.0:1789601511.121821:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601511.132235:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601511.133261:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858554240 00000100:00100000:0.0:1789601511.133274:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858554240 00000100:00100000:1.0:1789601511.133535:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 233 00000100:00100000:1.0:1789601511.133546:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+26:11639:x1876532858554240:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601511.133568:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601511.133589:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158acebb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50613bc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601511.133688:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acec2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601511.133704:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601511.133717:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601511.133728:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789601511.133886:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158acebb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613bc expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601511.133922:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acec2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613bc expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601511.133931:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:1.0:1789601511.133945:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789601511.133949:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c4e00, rc 0) 00000100:00100000:1.0:1789601511.134072:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+28:11639:x1876532858554240:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 528us (1846us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789601511.134080:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 233 00000100:00100000:2.0:1789601511.140511:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601511.140772:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601511.141181:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858554368 00000100:00100000:0.0:1789601511.141192:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858554368 00000100:00100000:0.0:1789601511.141258:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1789601511.141269:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00661880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+28:2358:x1876532858554368:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601511.141284:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601511.141309:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4e00/0xf3d6e402158acec2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613bc expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601511.141329:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:0.0:1789601511.141334:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601511.141400:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00661880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+27:2358:x1876532858554368:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 133us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601511.141408:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:1.0:1789601511.141730:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858554624 00000100:00100000:1.0:1789601511.141735:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858554624 00000100:00100000:1.0:1789601511.141778:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 234 00000100:00100000:1.0:1789601511.141785:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+27:11639:x1876532858554624:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789601511.141889:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158aced0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601511.141905:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158aced0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601511.141915:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158aced0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601511.142154:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158aced0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601511.142163:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158aced0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601511.142189:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158aced0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601511.142195:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601511.142199:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158aced0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601511.142206:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158aced0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601511.142215:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:1.0:1789601511.142218:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789601511.142223:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158aced0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601511.142229:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158aced0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601511.142364:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+28:11639:x1876532858554624:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 579us (1864us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789601511.142373:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 234 00000040:00080000:1.0:1789601511.142494:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601511.142499:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601511.143030:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789601511.143037:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789601511.148607:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601511.148730:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858554880 00000100:00100000:1.0:1789601511.148744:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858554880 00000100:00100000:1.0:1789601511.148882:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 64 00000100:00100000:1.0:1789601511.148907:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+28:11639:x1876532858554880:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789601511.149811:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+29:11639:x1876532858554880:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 915us (1212us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789601511.149821:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 64 00010000:00010000:2.0:1789601511.433451:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601511.895697:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601511.895742:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601511.895781:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601511.895811:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601511.895881:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601511.895912:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858555392 00000100:00100000:3.0:1789601511.895923:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858555392 00000100:00100000:3.0:1789601511.895998:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858555264 00000100:00100000:3.0:1789601511.896001:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858555264 00000100:00100000:3.0:1789601511.896030:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:3.0:1789601511.896041:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2358:x1876532858555392:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601511.896116:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 104 00000100:00100000:0.0:1789601511.896128:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2358:x1876532858555264:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601511.896135:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2358:x1876532858555392:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 92us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601511.896145:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:0.0:1789601511.896167:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2358:x1876532858555264:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 41us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601511.896172:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858555136 00000100:00100000:3.0:1789601511.896177:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858555136 00000100:00100000:0.0:1789601511.896177:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 104 00000100:00100000:0.0:1789601511.896209:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858555520 00000100:00100000:0.0:1789601511.896214:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858555520 00000100:00100000:3.0:1789601511.896215:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 176 00000100:00100000:3.0:1789601511.896230:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+29:2358:x1876532858555136:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601511.896255:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 177 00000100:00100000:0.0:1789601511.896265:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85db4f7d-704a-4080-a137-b2930e072a8c+5:2358:x1876532858555520:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601511.896272:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+29:2358:x1876532858555136:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 44us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601511.896292:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 176 00000100:00100000:0.0:1789601511.896313:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:85db4f7d-704a-4080-a137-b2930e072a8c+5:2358:x1876532858555520:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 48us (429us total) trans 0 rc 0/0 00000100:00080000:3.0:1789601511.896322:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601511.896329:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601511.896330:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 177 00000100:00080000:3.0:1789601511.896332:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789601511.896373:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858555008 00000100:00100000:0.0:1789601511.896378:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858555008 00000100:00100000:0.0:1789601511.896402:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 302 00000100:00100000:0.0:1789601511.896408:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2358:x1876532858555008:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601511.896445:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2358:x1876532858555008:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 38us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601511.896452:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 302 00000001:00080000:3.0:1789601511.959389:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1789601511.959411:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1789601511.959419:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:3.0:1789601512.397598:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee008d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880559616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601512.397691:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601512.398277:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880559616 00000100:00100000:0.0:1789601512.398288:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880559616 00000100:00100000:0.0:1789601512.398358:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789601512.398368:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880559616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789601512.398404:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789601512.398573:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601512.399010:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880559616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 642us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601512.399019:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789601512.399260:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789601512.399266:0:3319:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1789601512.399307:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91ee00660380, transno 4294967310 00000100:00100000:3.0:1789601512.399374:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee008d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880559616:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789601512.457083:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789601512.821518:0:12653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601512.821529:0:12653:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601512.821574:0:12653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789601512.821580:0:12653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789601513.030319:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601513.030672:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858555776 00000100:00100000:1.0:1789601513.030684:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858555776 00000100:00080000:3.0:1789601513.030752:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601513.030775:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 235 00000100:00100000:1.0:1789601513.030786:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+29:11659:x1876532858555776:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1789601513.030816:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601513.030861:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158aced7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50613c3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601513.030975:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acede lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601513.030990:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acede lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601513.031003:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acede lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601513.031016:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789601513.031157:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158aced7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613c3 expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601513.031223:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acede lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613c3 expref: 31 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601513.031231:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:1.0:1789601513.031234:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789601513.031238:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c5e00, rc 0) 00000100:00100000:1.0:1789601513.031306:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+31:11659:x1876532858555776:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 522us (995us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789601513.031313:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 235 00000100:00100000:0.0:1789601513.042106:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601513.042541:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858555904 00000100:00100000:2.0:1789601513.042553:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858555904 00000100:00100000:2.0:1789601513.042621:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 236 00000100:00100000:2.0:1789601513.042632:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+31:11659:x1876532858555904:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:2.0:1789601513.042703:0:8248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aceec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.042724:0:8248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aceec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.042737:0:8248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aceec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.042776:0:8248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aceec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.042783:0:8248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aceec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.042802:0:8248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aceec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.042808:0:8248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8cc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601513.042813:0:8248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aceec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.042820:0:8248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aceec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.042859:0:8248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:2.0:1789601513.042863:0:8248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789601513.042869:0:8248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aceec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601513.042875:0:8248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158aceec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601513.042962:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+31:11659:x1876532858555904:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 332us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601513.042970:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 236 00000100:00100000:3.0:1789601513.159700:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601513.159745:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858556032 00000100:00100000:3.0:1789601513.159766:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858556032 00000100:00100000:3.0:1789601513.159865:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00100000:3.0:1789601513.159876:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2356:x1876532858556032:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:3.0:1789601513.159895:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601513.159917:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158acef3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50613ca expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789601513.159958:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aab26e5, atime: 0x6aab26e5, ctime: 0x6aab26e5, blocks: 0xb 00010000:00010000:3.0:1789601513.159978:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=383s v=(0 0) 00010000:00010000:3.0:1789601513.159983:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601513.159993:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158acef3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613ca expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.160287:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158acef3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613ca expref: 8 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601513.160304:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc200, rc 0) 00000100:00100000:3.0:1789601513.160365:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2356:x1876532858556032:12345-192.168.201.30@tcp:101:cat.0 Request processed in 491us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601513.160373:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 71 00000100:00080000:3.0:1789601513.160416:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601513.165205:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601513.165688:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858556160 00000100:00100000:3.0:1789601513.165700:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858556160 00002000:00100000:3.0:1789601513.165908:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff91ee00660380 x1876532858556160/t0(0) o3->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:109/0 lens 488/0 e 0 to 0 dl 1789601524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789601513.165921:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91ee00660380 with x1876532858556160 ext(0->4095) 00002000:00010000:3.0:1789601513.165928:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91ee00660380 00000100:00100000:3.0:1789601513.165971:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:3.0:1789601513.165983:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2357:x1876532858556160:12345-192.168.201.30@tcp:3:cat.0 00000100:00100000:3.0:1789601513.166911:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+8:2357:x1876532858556160:12345-192.168.201.30@tcp:3:cat.0 Request processed in 927us (1711us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789601513.166921:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00002000:00100000:3.0:1789601513.166930:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff91ee00660380 x1876532858556160/t0(0) o3->701b9d85-0ce5-4d2b-ab0c-4b70676e08b6@192.168.201.30@tcp:109/0 lens 488/4536 e 0 to 0 dl 1789601524 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789601513.166953:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91ee00660380 with x1876532858556160 ext(0->4095) 00002000:00010000:3.0:1789601513.166959:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff91ee00660380 00010000:00010000:2.0:1789601513.481422:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601514.444927:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc71a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880560128:0@lo:400:kworker.0 00000100:00100000:2.0:1789601514.444942:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc71a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880559744:0@lo:400:kworker.0 00000100:00100000:2.0:1789601514.445005:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601514.445103:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880559744 00000100:00100000:0.0:1789601514.445114:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880559744 00000100:00100000:1.0:1789601514.445150:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc71a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880560000:0@lo:400:kworker.0 00000100:00100000:0.0:1789601514.445181:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789601514.445197:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880559744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601514.446834:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601514.447202:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880560256:0@lo:400:kworker.0 00000100:00100000:2.0:1789601514.447257:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601514.447311:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc71a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880559872:0@lo:400:kworker.0 00000100:00100000:0.0:1789601514.447518:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880559744:12345-0@lo:400:kworker.0 Request processed in 2320us (2518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601514.447529:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789601514.447601:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601514.447666:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880560384:0@lo:400:kworker.0 00000100:00100000:0.0:1789601514.447755:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880560256 00000100:00100000:2.0:1789601514.447883:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601514.448016:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880560256 00000100:00100000:0.0:1789601514.448069:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880559872 00000100:00100000:0.0:1789601514.448073:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880559872 00000100:00100000:0.0:1789601514.448097:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789601514.448105:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880560256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601514.448155:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880560256:12345-0@lo:400:kworker.0 Request processed in 51us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601514.448161:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789601514.448174:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789601514.448180:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880559872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601514.448210:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880559872:12345-0@lo:400:kworker.0 Request processed in 30us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601514.448215:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789601514.448220:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601514.448225:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880560000 00000100:00100000:0.0:1789601514.448227:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880560000 00000100:00100000:0.0:1789601514.448242:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789601514.448247:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880560000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601514.448287:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880560000:12345-0@lo:400:kworker.0 Request processed in 39us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601514.448292:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789601514.448403:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc71a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880560000:0@lo:400:kworker.0 00000100:00100000:2.0:1789601514.448493:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc71a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880559872:0@lo:400:kworker.0 00000100:00100000:2.0:1789601514.448517:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880560128 00000100:00100000:2.0:1789601514.448521:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880560128 00000100:00100000:2.0:1789601514.448557:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880560384 00000100:00100000:2.0:1789601514.448561:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880560384 00000100:00100000:2.0:1789601514.448594:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789601514.448602:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880560128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601514.448638:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880560128:12345-0@lo:400:kworker.0 Request processed in 38us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601514.448644:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789601514.448655:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789601514.448660:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1876532880560384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601514.448990:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3317:x1876532880560384:12345-0@lo:400:kworker.0 Request processed in 328us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601514.448997:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789601514.449183:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880560384:0@lo:400:kworker.0 00000100:00100000:2.0:1789601514.449209:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc71a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880559744:0@lo:400:kworker.0 00000100:00100000:2.0:1789601514.449239:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880560256:0@lo:400:kworker.0 00000100:00080000:2.0:1789601514.450084:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789601514.450090:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789601514.450093:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601514.457952:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc71a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880560128:0@lo:400:kworker.0 00010000:00010000:3.0:1789601514.506010:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601514.954331:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601514.954356:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880560512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601514.954490:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601514.954675:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880560512 00000100:00100000:1.0:1789601514.954683:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880560512 00000100:00100000:1.0:1789601514.954736:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789601514.954747:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1876532880560512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601514.954782:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601514.954829:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1876532880560512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601514.954854:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789601514.955005:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880560512:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1789601515.060129:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1789601515.060165:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1789601515.060206:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91edc8dbfb40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1789601515.060211:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91edf7ed6700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91edc8dbfc00 00000020:00080000:2.0:1789601515.060214:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91edf7ed6e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91ee00b82800 00000020:00080000:0.0:1789601515.060320:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1789601515.060520:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1789601515.062116:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1789601515.062143:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:2.0:1789601515.529156:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601516.553292:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601517.017705:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601517.017787:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601517.017816:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858556672 00000100:00100000:0.0:1789601517.017864:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858556672 00000100:00100000:0.0:1789601517.017953:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 107 00000100:00100000:0.0:1789601517.017965:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2359:x1876532858556672:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601517.018243:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2359:x1876532858556672:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 171us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601517.018317:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 107 00000100:00080000:0.0:1789601517.018347:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789601517.025654:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858556416 00000100:00100000:1.0:1789601517.025678:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858556416 00000100:00100000:1.0:1789601517.025779:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 181 00000100:00100000:1.0:1789601517.025792:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:2359:x1876532858556416:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:0.0:1789601517.025807:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601517.026112:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:2359:x1876532858556416:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 321us (8419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601517.026121:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 181 00000100:00100000:3.0:1789601517.027253:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601517.027291:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601517.027321:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601517.030319:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858556544 00000100:00100000:2.0:1789601517.030340:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858556544 00000100:00100000:2.0:1789601517.030457:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 108 00000100:00100000:2.0:1789601517.030470:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2358:x1876532858556544:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601517.030589:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2358:x1876532858556544:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 122us (3296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601517.030598:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 108 00000100:00080000:3.0:1789601517.030705:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601517.031498:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858556288 00000100:00100000:0.0:1789601517.031513:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858556288 00000100:00100000:0.0:1789601517.031590:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 304 00000100:00100000:0.0:1789601517.031602:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2358:x1876532858556288:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601517.031751:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2358:x1876532858556288:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 80us (4433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601517.031763:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 304 00000100:00100000:0.0:1789601517.032378:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858556800 00000100:00100000:0.0:1789601517.032385:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858556800 00000100:00100000:0.0:1789601517.032442:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 182 00000100:00100000:0.0:1789601517.032450:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+5:2358:x1876532858556800:12345-192.168.201.30@tcp:400:kworker.0 00000100:00080000:3.0:1789601517.032483:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601517.032496:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:85db4f7d-704a-4080-a137-b2930e072a8c+5:2358:x1876532858556800:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 44us (5171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601517.032504:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 182 00000100:00100000:1.0:1789601517.513132:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601517.513165:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee008d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880560640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601517.513258:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601517.513345:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880560640 00000100:00100000:1.0:1789601517.513355:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880560640 00000100:00100000:1.0:1789601517.513422:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789601517.513433:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880560640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601517.513481:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601517.513545:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880560640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601517.513553:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1789601517.513579:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601517.515121:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee008d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880560640:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789601517.577872:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601517.772413:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601517.772761:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858556928 00000100:00100000:0.0:1789601517.772776:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858556928 00000100:00100000:0.0:1789601517.772890:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 237 00000100:00100000:0.0:1789601517.772902:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee008d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:11304:x1876532858556928:12345-192.168.201.30@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789601517.773074:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee008d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:11304:x1876532858556928:12345-192.168.201.30@tcp:60:lhsmtool_posix.0 Request processed in 173us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601517.773082:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 237 00000100:00100000:0.0:1789601517.784201:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601517.784993:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858557184 00000100:00100000:1.0:1789601517.785022:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858557184 00000100:00100000:1.0:1789601517.785125:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 65 00000100:00100000:1.0:1789601517.785138:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:11304:x1876532858557184:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789601517.785608:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:11304:x1876532858557184:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 471us (1422us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1789601517.785617:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 65 00010000:00010000:3.0:1789601518.601817:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789601519.370502:0:11667:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789601519.370512:0:11667:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789601519.373172:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1789601519.373190:0:11667:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789601519.565008:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601519.565032:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880560768:0@lo:400:kworker.0 00000100:00100000:2.0:1789601519.565098:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880561024:0@lo:400:kworker.0 00000100:00100000:1.0:1789601519.565497:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880561280:0@lo:400:kworker.0 00000100:00100000:3.0:1789601519.565564:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601519.565627:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880561152:0@lo:400:kworker.0 00000100:00100000:3.0:1789601519.565655:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601519.567398:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601519.567487:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789601519.567500:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00a58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880560896:0@lo:400:kworker.0 00000100:00100000:2.0:1789601519.567548:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601519.567570:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880561408:0@lo:400:kworker.0 00000100:00100000:3.0:1789601519.567571:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880561024 00000100:00100000:3.0:1789601519.567589:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880561024 00000100:00100000:2.0:1789601519.567593:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601519.567696:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880560896 00000100:00100000:1.0:1789601519.567699:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601519.567700:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880560896 00000100:00100000:0.0:1789601519.568702:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880560768 00000100:00100000:0.0:1789601519.568713:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880560768 00000100:00100000:0.0:1789601519.568755:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789601519.568765:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc82f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3319:x1876532880560768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601519.568865:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc82f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3319:x1876532880560768:12345-0@lo:400:kworker.0 Request processed in 102us (3302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601519.568873:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789601519.568910:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880561152 00000100:00100000:0.0:1789601519.568913:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880561152 00000100:00100000:0.0:1789601519.568939:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880561408 00000100:00100000:0.0:1789601519.568942:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880561408 00000100:00100000:0.0:1789601519.568965:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789601519.568971:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880561152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601519.569004:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880561152:12345-0@lo:400:kworker.0 Request processed in 33us (3348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601519.569010:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789601519.569021:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789601519.569027:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9da9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880561408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601519.569059:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9da9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880561408:12345-0@lo:400:kworker.0 Request processed in 33us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601519.569065:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1789601519.571508:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601519.571519:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789601519.571524:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601519.571540:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880561280 00000100:00100000:1.0:1789601519.571550:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880561280 00000100:00100000:1.0:1789601519.571605:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789601519.571614:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880561024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601519.571687:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880561024:12345-0@lo:400:kworker.0 Request processed in 76us (4297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601519.571694:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789601519.571712:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789601519.571719:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc8310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880560896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601519.571746:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc8310700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880560896:12345-0@lo:400:kworker.0 Request processed in 29us (4198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601519.571751:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789601519.571765:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789601519.571771:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880561280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601519.571801:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880561280:12345-0@lo:400:kworker.0 Request processed in 31us (4102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601519.571806:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00080000:1.0:1789601519.571818:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601519.571901:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880561280:0@lo:400:kworker.0 00000100:00100000:1.0:1789601519.578121:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880561152:0@lo:400:kworker.0 00000100:00100000:1.0:1789601519.578151:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880560768:0@lo:400:kworker.0 00000100:00100000:0.0:1789601519.580546:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880560896:0@lo:400:kworker.0 00000100:00100000:0.0:1789601519.580576:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1789601519.580581:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91edf83bed80, transno 4294967322 00000004:00080000:0.0:1789601519.580602:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1789601519.580627:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880561408:0@lo:400:kworker.0 00000100:00100000:0.0:1789601519.580641:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880561024:0@lo:400:kworker.0 00010000:00010000:2.0:1789601519.625237:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789601519.916692:0:12854:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 19:31:59 (1789601519) 00000100:00100000:0.0:1789601520.076130:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880561536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601520.076201:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601520.076331:0:10225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880561536 00000100:00100000:2.0:1789601520.076339:0:10225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880561536 00000100:00100000:2.0:1789601520.076389:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789601520.076399:0:10225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880561536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601520.076433:0:10225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601520.076488:0:10225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880561536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601520.076495:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789601520.088122:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880561536:0@lo:13:osp-pre-1-0.0 00000020:00080000:1.0:1789601520.167114:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:1.0:1789601520.167137:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1789601520.167231:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789601520.167242:0:5870:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1789601520.650758:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601521.673987:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601522.135228:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601522.135282:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601522.135298:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858557312 00000100:00100000:3.0:1789601522.135317:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858557312 00000100:00100000:2.0:1789601522.135318:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601522.135349:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601522.135381:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601522.135401:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 306 00000100:00100000:3.0:1789601522.135416:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2359:x1876532858557312:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601522.135429:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858557568 00000100:00100000:2.0:1789601522.135440:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858557568 00000100:00100000:2.0:1789601522.135515:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858557696 00000100:00100000:2.0:1789601522.135520:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858557696 00000100:00100000:3.0:1789601522.135542:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+13:2359:x1876532858557312:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 109us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601522.135554:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00100000:3.0:1789601522.135561:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 306 00000100:00100000:2.0:1789601522.135572:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2359:x1876532858557568:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601522.135640:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9dab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2359:x1876532858557568:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 73us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601522.135664:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00100000:2.0:1789601522.135682:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 112 00000100:00100000:2.0:1789601522.135689:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2359:x1876532858557696:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601522.135713:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2359:x1876532858557696:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 25us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601522.135718:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 112 00000100:00100000:2.0:1789601522.135736:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858557824 00000100:00100000:2.0:1789601522.135739:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858557824 00000100:00100000:2.0:1789601522.135768:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858557440 00000100:00100000:2.0:1789601522.135771:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858557440 00000100:00100000:2.0:1789601522.135807:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 186 00000100:00100000:2.0:1789601522.135815:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85db4f7d-704a-4080-a137-b2930e072a8c+5:2359:x1876532858557824:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601522.135867:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 187 00000100:00100000:3.0:1789601522.135881:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:2359:x1876532858557440:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601522.135893:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9daa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85db4f7d-704a-4080-a137-b2930e072a8c+5:2359:x1876532858557824:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 76us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601522.135902:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 186 00000100:00080000:2.0:1789601522.135939:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601522.135940:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:2359:x1876532858557440:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 58us (584us total) trans 0 rc 0/0 00000100:00080000:2.0:1789601522.135946:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789601522.135949:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601522.135964:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 187 00000100:00100000:3.0:1789601522.329432:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601522.329635:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858557952 00000100:00100000:2.0:1789601522.329648:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858557952 00000100:00100000:2.0:1789601522.329720:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 238 00000100:00100000:2.0:1789601522.329729:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85db4f7d-704a-4080-a137-b2930e072a8c+5:12324:x1876532858557952:12345-192.168.201.30@tcp:101:lsof.0 00010000:00010000:2.0:1789601522.329750:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601522.329768:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158acefa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50613d1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601522.330376:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acf01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601522.330394:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acf01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601522.330408:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acf01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601522.330445:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789601522.330449:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789601522.330494:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acf01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601522.330585:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d800/0xf3d6e402158acefa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613d1 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601522.330607:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acf01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613d1 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601522.330682:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8ce5c00) 00010000:00010000:0.0:1789601522.330685:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789601522.330689:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924800, rc 0) 00000100:00100000:0.0:1789601522.330815:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7eded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85db4f7d-704a-4080-a137-b2930e072a8c+6:12324:x1876532858557952:12345-192.168.201.30@tcp:101:lsof.0 Request processed in 1085us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601522.330823:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 238 00000100:00100000:2.0:1789601522.633662:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601522.634269:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edc71a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880561664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601522.634360:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601522.634514:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880561664 00000100:00100000:1.0:1789601522.634524:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880561664 00000100:00080000:3.0:1789601522.634590:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601522.634619:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789601522.634631:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880561664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601522.634673:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601522.634722:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880561664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601522.634729:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789601522.634868:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edc71a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880561664:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789601522.697064:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601523.722932:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601524.173315:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601524.173650:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858558208 00000100:00100000:2.0:1789601524.173661:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858558208 00000100:00100000:2.0:1789601524.173783:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00100000:2.0:1789601524.173796:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+18:12325:x1876532858558208:12345-192.168.201.30@tcp:35:umount.0 00000100:00100000:2.0:1789601524.174200:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:12325:x1876532858558208:12345-192.168.201.30@tcp:35:umount.0 Request processed in 407us (894us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789601524.174208:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 66 00000100:00080000:3.0:1789601524.179066:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789601524.181249:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601524.181362:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858558464 00000100:00100000:1.0:1789601524.181373:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858558464 00000100:00100000:1.0:1789601524.181436:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:1.0:1789601524.181447:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+19:12325:x1876532858558464:12345-192.168.201.30@tcp:35:umount.0 00000100:00100000:1.0:1789601524.181811:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:12325:x1876532858558464:12345-192.168.201.30@tcp:35:umount.0 Request processed in 365us (569us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789601524.181819:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 67 00000100:00100000:0.0:1789601524.187772:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601524.188706:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858558720 00000100:00100000:1.0:1789601524.188719:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858558720 00000100:00100000:1.0:1789601524.188798:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:1.0:1789601524.188810:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91eddcda9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+20:12325:x1876532858558720:12345-192.168.201.30@tcp:35:umount.0 00000100:00100000:1.0:1789601524.189329:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91eddcda9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:12325:x1876532858558720:12345-192.168.201.30@tcp:35:umount.0 Request processed in 519us (1566us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789601524.189338:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 68 00000100:00100000:0.0:1789601524.203255:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601524.209472:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858558976 00000100:00100000:3.0:1789601524.209489:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858558976 00000100:00100000:3.0:1789601524.209564:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:3.0:1789601524.210001:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:12325:x1876532858558976:12345-192.168.201.30@tcp:35:umount.0 00000100:00100000:3.0:1789601524.210421:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:12325:x1876532858558976:12345-192.168.201.30@tcp:35:umount.0 Request processed in 847us (7176us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789601524.210431:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 69 00000100:00100000:2.0:1789601524.218426:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601524.218515:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601524.218583:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601524.218749:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858559104 00000100:00100000:1.0:1789601524.218761:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858559104 00000100:00100000:1.0:1789601524.218830:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858559232 00000100:00100000:1.0:1789601524.218833:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858559232 00000100:00100000:1.0:1789601524.218872:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858559360 00000100:00100000:1.0:1789601524.218889:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858559360 00000100:00100000:1.0:1789601524.218912:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:1.0:1789601524.218921:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+15:2358:x1876532858559104:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601524.218938:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601524.218958:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc29c5a00/0xf3d6e402158abf87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f63 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601524.218975:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601524.219023:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:0.0:1789601524.219035:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+14:2359:x1876532858559232:12345-192.168.201.30@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789601524.219038:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+14:2358:x1876532858559104:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 116us (617us total) trans 0 rc 0/0 00010000:00010000:0.0:1789601524.219046:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789601524.219049:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00010000:00010000:0.0:1789601524.219060:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ee02045800/0xf3d6e402158abeed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f2b expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601524.219070:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00010000:00010000:0.0:1789601524.219071:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601524.219080:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:2359:x1876532858559360:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601524.219090:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789601524.219097:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:2359:x1876532858559232:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 65us (628us total) trans 0 rc 0/0 00010000:00010000:1.0:1789601524.219102:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc3b89a00/0xf3d6e402158ac19b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506102e expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601524.219109:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00010000:00010000:1.0:1789601524.219120:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601524.219143:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2359:x1876532858559360:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 66us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601524.219150:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:0.0:1789601524.222074:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601524.222149:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858559744 00000100:00100000:2.0:1789601524.222161:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858559744 00000100:00100000:2.0:1789601524.222239:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 72 00000100:00100000:2.0:1789601524.222250:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+7:2355:x1876532858559744:12345-192.168.201.30@tcp:9:umount.0 00000020:00000080:2.0:1789601524.222281:0:6679:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158ac4c0 00000020:00010000:2.0:1789601524.222288:0:6679:0:(genops.c:1920:obd_stale_export_put()) Put export ffff91edc2a52800: total 0 00000100:00080000:2.0:1789601524.222293:0:6679:0:(import.c:65:import_set_state_nolock()) ffff91edf9db7000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789601524.222337:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1789601524.222641:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2355:x1876532858559744:12345-192.168.201.30@tcp:9:umount.0 Request processed in 393us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601524.222664:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 72 00000020:00010000:0.0:1789601524.222990:0:5826:0:(genops.c:1906:obd_stale_export_get()) Get export ffff91edc2a52800: total 0 00010000:00010000:0.0:1789601524.223023:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91edc2a52800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789601524.223074:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a24cc6a/0xf3d6e402158ac863 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061203 expref: 4 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601524.223123:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158acef3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613ca expref: 3 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601524.223138:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91edc2a52800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789601524.223150:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601524.223153:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601524.223154:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789601524.223405:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789601524.233793:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601524.234026:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858559872 00000100:00100000:2.0:1789601524.234038:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858559872 00000100:00100000:2.0:1789601524.234116:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:2.0:1789601524.234128:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+5:2355:x1876532858559872:12345-192.168.201.30@tcp:9:umount.0 00000020:00000080:2.0:1789601524.234159:0:6676:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158ac25f 00000100:00080000:2.0:1789601524.234168:0:6676:0:(import.c:65:import_set_state_nolock()) ffff91edefeed000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789601524.234213:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:3.0:1789601524.234695:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789601524.234868:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601524.235662:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+2:2355:x1876532858559872:12345-192.168.201.30@tcp:9:umount.0 Request processed in 1531us (1871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601524.235675:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 73 00000100:00100000:1.0:1789601524.251356:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601524.251657:0:8248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858560896 00000100:00100000:2.0:1789601524.251667:0:8248:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858560896 00000100:00100000:2.0:1789601524.251729:0:8248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 239 00000100:00100000:2.0:1789601524.251749:0:8248:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+22:2355:x1876532858560896:12345-192.168.201.30@tcp:39:umount.0 00000020:00000080:2.0:1789601524.251784:0:8248:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abefb 00000020:00010000:2.0:1789601524.251803:0:8248:0:(genops.c:1920:obd_stale_export_put()) Put export ffff91edffe9e000: total 0 00000100:00080000:2.0:1789601524.251808:0:8248:0:(import.c:65:import_set_state_nolock()) ffff91edf9db2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789601524.251931:0:8248:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:2.0:1789601524.252293:0:8248:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:701b9d85-0ce5-4d2b-ab0c-4b70676e08b6+21:2355:x1876532858560896:12345-192.168.201.30@tcp:39:umount.0 Request processed in 553us (945us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1789601524.252301:0:8248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 239 00000020:00010000:0.0:1789601524.252667:0:5826:0:(genops.c:1906:obd_stale_export_get()) Get export ffff91edffe9e000: total 0 00010000:00010000:0.0:1789601524.252672:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601524.252714:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91edffe9e000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789601524.252756:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:0.0:1789601524.252759:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789601524.252767:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924e00/0xf3d6e402158ac522 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506112a expref: 20 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601524.252786:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91edd8a67e00) 00010000:00010000:0.0:1789601524.252788:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789601524.252792:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c200/0xf3d6e402158ac1c5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506103c expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601524.252822:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:0.0:1789601524.252825:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789601524.252829:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadce00/0xf3d6e402158aceb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613b5 expref: 18 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601524.253040:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8ce5c00) 00010000:00010000:0.0:1789601524.253043:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789601524.253048:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadc800/0xf3d6e402158ac8b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061218 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601524.253062:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:0.0:1789601524.253064:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789601524.253068:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5e00/0xf3d6e402158acede lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613c3 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601524.253080:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:0.0:1789601524.253082:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789601524.253087:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadd600/0xf3d6e402158ac744 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611b6 expref: 15 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601524.253100:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:0.0:1789601524.253103:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789601524.253107:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925e00/0xf3d6e402158acbb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50612f1 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601524.253119:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91edd8a67700) 00010000:00010000:0.0:1789601524.253121:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789601524.253124:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ac235 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061058 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601524.253138:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91edd35e8500) 00010000:00010000:0.0:1789601524.253141:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789601524.253151:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffadca00/0xf3d6e402158acdd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506137d expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601524.253167:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91edd8ce5300) 00010000:00010000:0.0:1789601524.253170:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789601524.253174:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edffaddc00/0xf3d6e402158ac8d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506121f expref: 11 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601524.253190:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91edd35e8700) 00010000:00010000:0.0:1789601524.253192:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601524.253196:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ac1e1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061043 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601524.253212:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:0.0:1789601524.253215:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789601524.253219:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5800/0xf3d6e402158ac84e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611fc expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601524.253230:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91edd8ce5900) 00010000:00010000:0.0:1789601524.253232:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789601524.253235:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ac824 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50611ee expref: 8 pid: 8248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601524.253247:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91edffe9e000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1789601524.253261:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601524.253263:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601524.253265:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601524.683769:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880562176:0@lo:400:kworker.0 00000100:00100000:0.0:1789601524.683789:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880561920:0@lo:400:kworker.0 00000100:00100000:1.0:1789601524.683887:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880561792:0@lo:400:kworker.0 00000100:00100000:0.0:1789601524.691067:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601524.691180:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880562432:0@lo:400:kworker.0 00000100:00100000:2.0:1789601524.691182:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880561920 00000100:00100000:2.0:1789601524.691191:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880561920 00000100:00100000:0.0:1789601524.691219:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601524.691243:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789601524.691250:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789601524.691251:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880561920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601524.691256:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880562048:0@lo:400:kworker.0 00000100:00100000:0.0:1789601524.691278:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601524.691311:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880562432 00000100:00100000:0.0:1789601524.691315:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880562432 00000100:00100000:2.0:1789601524.691316:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880561920:12345-0@lo:400:kworker.0 Request processed in 66us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601524.691323:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789601524.691348:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880562048 00000100:00100000:0.0:1789601524.691350:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789601524.691351:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880562048 00000100:00100000:0.0:1789601524.691356:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880562432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601524.691370:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789601524.691375:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880562048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601524.691386:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880562432:12345-0@lo:400:kworker.0 Request processed in 31us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601524.691392:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789601524.691410:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880562048:12345-0@lo:400:kworker.0 Request processed in 35us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601524.691415:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789601524.691424:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880562048:0@lo:400:kworker.0 00000100:00100000:0.0:1789601524.691435:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880561920:0@lo:400:kworker.0 00000100:00100000:0.0:1789601524.691444:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880562432:0@lo:400:kworker.0 00000100:00080000:2.0:1789601524.691455:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789601524.691472:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601524.694098:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601524.694171:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880562176 00000100:00100000:0.0:1789601524.694180:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880562176 00000100:00100000:0.0:1789601524.694244:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789601524.694253:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880562176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601524.694322:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7edea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880562176:12345-0@lo:400:kworker.0 Request processed in 72us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601524.694328:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789601524.696413:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601524.696464:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880562304:0@lo:400:kworker.0 00000100:00100000:1.0:1789601524.696507:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601524.696585:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880562304 00000100:00100000:1.0:1789601524.696594:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880562304 00000100:00100000:1.0:1789601524.696647:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789601524.696654:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880562304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601524.696709:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880562304:12345-0@lo:400:kworker.0 Request processed in 55us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601524.696715:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789601524.696767:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880562304:0@lo:400:kworker.0 00000100:00080000:3.0:1789601524.699889:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789601524.699904:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601524.699964:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880562176:0@lo:400:kworker.0 00000100:00100000:0.0:1789601524.700246:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880561792 00000100:00100000:0.0:1789601524.700256:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880561792 00000100:00100000:0.0:1789601524.700332:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1789601524.700341:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880561792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601524.700448:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880561792:12345-0@lo:400:kworker.0 Request processed in 108us (4042us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601524.700454:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1789601524.704374:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880561792:0@lo:400:kworker.0 00010000:00010000:0.0:1789601524.745371:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601525.193255:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf83bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880562560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601525.193323:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601525.193652:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880562560 00000100:00100000:0.0:1789601525.193661:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880562560 00000100:00100000:0.0:1789601525.193713:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789601525.193730:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880562560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789601525.193762:0:6680:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789601525.193804:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880562560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601525.193810:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789601525.194251:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf83bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880562560:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1789601525.260475:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 00000020:00000080:2.0:1789601525.260485:0:7635:0:(genops.c:885:class_export_put()) final put ffff91edc2a52800/701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 00000020:00000080:0.0:1789601525.260820:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91edc2a52800/701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 for lustre-OST0001 00000020:00000080:0.0:1789601525.260901:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91edf9db7000 for lustre-OST0001 00000001:00080000:2.0:1789601525.276286:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:2.0:1789601525.276308:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 00000001:00080000:2.0:1789601525.276314:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1789601525.276324:0:5859:0:(genops.c:885:class_export_put()) final put ffff91edffe9e000/701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 00000020:00000080:0.0:1789601525.276567:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91edffe9e000/701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 for lustre-MDT0000 00000020:00000080:0.0:1789601525.276637:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91edf9db2800 for lustre-MDT0000 00010000:00010000:0.0:1789601525.771966:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601526.441879:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601526.441935:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601526.441977:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601526.445739:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858561152 00000100:00100000:1.0:1789601526.445761:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858561152 00000100:00100000:1.0:1789601526.445867:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858561024 00000100:00100000:1.0:1789601526.445870:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858561024 00000100:00100000:1.0:1789601526.445886:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858561280 00000100:00100000:1.0:1789601526.445889:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858561280 00000100:00100000:1.0:1789601526.445912:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:1.0:1789601526.445922:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+12:2356:x1876532858561152:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601526.445938:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601526.445958:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc0030a00/0xf3d6e402158abfd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060fa2 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601526.445977:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601526.446267:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:0.0:1789601526.446279:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+11:2356:x1876532858561024:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601526.446288:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601526.446299:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc0031400/0xf3d6e402158abfcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f78 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601526.446339:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601526.446374:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+10:2356:x1876532858561024:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 98us (4438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601526.446381:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:0.0:1789601526.446402:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:0.0:1789601526.446408:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede51e2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+9:2356:x1876532858561280:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601526.446416:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601526.446424:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edd8d8ca00/0xf3d6e402158ac194 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061027 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601526.446434:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601526.446449:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede51e2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+8:2356:x1876532858561280:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 42us (4473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601526.446454:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:1.0:1789601526.446931:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+7:2356:x1876532858561152:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1009us (5061us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601526.446950:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:0.0:1789601526.464639:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601526.465745:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858561536 00000100:00100000:2.0:1789601526.465759:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858561536 00000100:00100000:2.0:1789601526.465865:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 240 00000100:00100000:2.0:1789601526.465876:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85db4f7d-704a-4080-a137-b2930e072a8c+6:2355:x1876532858561536:12345-192.168.201.30@tcp:39:umount.0 00000020:00000080:2.0:1789601526.465924:0:5838:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abfe2 00000020:00010000:2.0:1789601526.465932:0:5838:0:(genops.c:1920:obd_stale_export_put()) Put export ffff91ee002a7800: total 0 00000100:00080000:2.0:1789601526.465937:0:5838:0:(import.c:65:import_set_state_nolock()) ffff91ee002a3800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789601526.465965:0:5838:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:0.0:1789601526.466234:0:5825:0:(genops.c:1906:obd_stale_export_get()) Get export ffff91ee002a7800: total 0 00010000:00010000:0.0:1789601526.466291:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91ee002a7800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789601526.466332:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd8ce5c00) 00010000:00010000:0.0:1789601526.466336:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789601526.466345:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158acf01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613d1 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601526.466370:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91ee002a7800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789601526.466382:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601526.466384:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601526.466386:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601526.466564:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:85db4f7d-704a-4080-a137-b2930e072a8c+3:2355:x1876532858561536:12345-192.168.201.30@tcp:39:umount.0 Request processed in 689us (1933us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1789601526.466577:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 240 00000100:00080000:3.0:1789601526.467009:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601526.511522:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601526.511925:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858561792 00000100:00100000:2.0:1789601526.511938:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858561792 00000100:00100000:2.0:1789601526.512001:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 308 00000100:00100000:2.0:1789601526.512017:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+7:2355:x1876532858561792:12345-192.168.201.30@tcp:251:umount.0 00000020:00000080:2.0:1789601526.512070:0:5832:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abed8 00000020:00010000:2.0:1789601526.512079:0:5832:0:(genops.c:1920:obd_stale_export_put()) Put export ffff91edffe9a000: total 0 00000100:00080000:2.0:1789601526.512083:0:5832:0:(import.c:65:import_set_state_nolock()) ffff91edffe9b000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789601526.512160:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:40e96c7a-a5b4-4553-9a17-8e4644c4cf0e+3:2355:x1876532858561792:12345-192.168.201.30@tcp:251:umount.0 Request processed in 150us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601526.512168:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 308 00000020:00010000:3.0:1789601526.512342:0:5826:0:(genops.c:1906:obd_stale_export_get()) Get export ffff91edffe9a000: total 0 00010000:00010000:3.0:1789601526.512348:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601526.512468:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91edffe9a000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789601526.512500:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc3b88e00/0xf3d6e402158abf8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5060f6a expref: 2 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601526.512527:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91edffe9a000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789601526.512554:0:5826:0:(genops.c:885:class_export_put()) final put ffff91edffe9a000/40e96c7a-a5b4-4553-9a17-8e4644c4cf0e 00010000:00010000:3.0:1789601526.512571:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601526.512573:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601526.512575:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789601526.512600:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91edffe9a000/40e96c7a-a5b4-4553-9a17-8e4644c4cf0e for MGS 00000020:00000080:1.0:1789601526.512645:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91edffe9b000 for MGS 00010000:00010000:0.0:1789601526.793206:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789601527.353342:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 00000020:00000080:3.0:1789601527.353351:0:6703:0:(genops.c:885:class_export_put()) final put ffff91edefeed800/701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 00000020:00000080:2.0:1789601527.353440:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91edefeed800/701b9d85-0ce5-4d2b-ab0c-4b70676e08b6 for lustre-OST0000 00000020:00000080:2.0:1789601527.353551:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91edefeed000 for lustre-OST0000 00000100:00100000:1.0:1789601527.753758:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601527.753793:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880562688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601527.753939:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601527.757980:0:10225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880562688 00000100:00100000:0.0:1789601527.758006:0:10225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880562688 00000100:00100000:0.0:1789601527.758192:0:10225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789601527.758205:0:10225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880562688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789601527.758257:0:10225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789601527.758376:0:10225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880562688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 174us (4437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601527.758384:0:10225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789601527.758471:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880562688:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789601527.761647:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789601527.817199:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789601528.390580:0:13055:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789601528.412004:0:13055:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789601528.412072:0:13055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abf5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601528.412090:0:13055:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abf5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abf64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601528.412098:0:13055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abf5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158abf64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601528.412106:0:13055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abf5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158abf64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601528.412135:0:13055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789601528.412142:0:13055:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789601528.412178:0:13055:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789601528.412183:0:13055:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789601528.412208:0:13055:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789601528.412244:0:13055:0:(import.c:65:import_set_state_nolock()) ffff91edf7938800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789601528.412347:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf83bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876532880562816:0@lo:39:umount.0 00000100:00100000:3.0:1789601528.412440:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601528.412583:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880562816 00000100:00100000:0.0:1789601528.412593:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880562816 00000100:00100000:0.0:1789601528.412656:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789601528.412677:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876532880562816:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789601528.412710:0:5839:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abce7 00000100:00080000:0.0:1789601528.412721:0:5839:0:(import.c:65:import_set_state_nolock()) ffff91ee00540000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789601528.412812:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7eddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3316:x1876532880562816:12345-0@lo:39:umount.0 Request processed in 146us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601528.412820:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:0.0:1789601528.412832:0:5839:0:(genops.c:885:class_export_put()) final put ffff91edf795d000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1789601528.412986:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601528.412995:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abf5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158abf64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601528.413004:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5400 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:3.0:1789601528.413009:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abf5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158abf64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601528.413019:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abf5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3d6e402158abf64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601528.413027:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abf5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3d6e402158abf64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601528.413034:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789601528.413037:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789601528.413040:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789601528.413079:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abf5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158abf64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601528.413086:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789601528.413128:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abf5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158abf64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601528.413136:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc29c5400/0xf3d6e402158abf5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158abf64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601528.413152:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601528.413154:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601528.413156:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789601528.413167:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91edf795d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789601528.413221:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91ee00540000 for lustre-MDT0000 00000100:00100000:3.0:1789601528.413233:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601528.413242:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880562944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601528.413277:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601528.413319:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880562944 00000100:00100000:3.0:1789601528.413324:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880562944 00000100:00100000:3.0:1789601528.413370:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789601528.413377:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3319:x1876532880562944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789601528.413391:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601528.413406:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc0031800/0xf3d6e402158abf64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3d6e402158abf5d expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601528.413421:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601528.413452:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:435644e3-9e9f-44ed-9cfe-21987eda72e5+18:3319:x1876532880562944:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601528.413458:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789601528.413496:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880562944:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789601528.413524:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91edf7938800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789601528.413541:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf83bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876532880562816:0@lo:39:umount.0 00000100:00080000:0.0:1789601528.413707:0:13055:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789601528.413710:0:13055:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789601528.413715:0:13055:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789601528.414752:0:13055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abf6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601528.414769:0:13055:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abf6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abf72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601528.414777:0:13055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abf6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158abf72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601528.414784:0:13055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abf6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158abf72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601528.414805:0:13055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789601528.414811:0:13055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abe92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abe99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601528.414868:0:13055:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abe92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abe99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601528.414875:0:13055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abe92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158abe99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601528.414881:0:13055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abe92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158abe99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601528.414883:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601528.414894:0:13055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601528.414896:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abf6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158abf72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601528.414902:0:13055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158ac186 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac18d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601528.414911:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4400 already unused, calling callback (ffffffffc1df7c20) 00010000:00010000:0.0:1789601528.414912:0:13055:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158ac186 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ac18d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601528.414918:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abf6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158abf72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601528.414921:0:13055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158ac186 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158ac18d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601528.414936:0:13055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158ac186 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158ac18d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601528.414938:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abf6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3d6e402158abf72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601528.414948:0:13055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:00010000:2.0:1789601528.414952:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abf6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3d6e402158abf72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601528.414956:0:13055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b88000/0xf3d6e402158abc46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abc4d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601528.414966:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789601528.414969:0:13055:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b88000/0xf3d6e402158abc46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abc4d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601528.414979:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789601528.414991:0:13055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b88000/0xf3d6e402158abc46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158abc4d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601528.414999:0:13055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff91edc3b88000/0xf3d6e402158abc46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158abc4d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601528.415007:0:13055:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1789601528.415011:0:13055:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1789601528.415014:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abf6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158abf72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601528.415017:0:13055:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1789601528.415024:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:0.0:1789601528.415049:0:13055:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789601528.415054:0:13055:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:2.0:1789601528.415057:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abf6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158abf72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789601528.415059:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1789601528.415067:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc29c4400/0xf3d6e402158abf6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158abf72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789601528.415068:0:13055:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1789601528.415079:0:13055:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff91ee00c8a800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789601528.415086:0:13055:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff91edffe44800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1789601528.415089:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789601528.415094:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abe92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158abe99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789601528.415096:0:13055:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff91ee002a7800 85db4f7d-704a-4080-a137-b2930e072a8c 192.168.201.30@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1789601528.415108:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88800 already unused, calling callback (ffffffffc1df7c20) 00000020:00080000:0.0:1789601528.415110:0:13055:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff91edd174cd40) has exports, disconnecting them 10000000:00010000:2.0:1789601528.415113:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abe92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158abe99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789601528.415117:0:13055:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91ee00c8a800), last request at 1789601524 00010000:00010000:2.0:1789601528.415126:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abe92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3d6e402158abe99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789601528.415128:0:13055:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abe5a 10000000:00010000:2.0:1789601528.415136:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abe92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3d6e402158abe99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601528.415141:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789601528.415144:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789601528.415146:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00080000:0.0:1789601528.415150:0:13055:0:(import.c:65:import_set_state_nolock()) ffff91ee00c8c000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789601528.415160:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abe92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158abe99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601528.415167:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601528.415179:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abe92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158abe99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601528.415186:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc3b88800/0xf3d6e402158abe92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158abe99 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601528.415201:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:0.0:1789601528.415203:0:13055:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff91ee00c8a800): rc 0 00010000:00010000:2.0:1789601528.415206:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158ac186 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158ac18d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789601528.415208:0:13055:0:(genops.c:885:class_export_put()) final put ffff91ee00c8a800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1789601528.415216:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89200 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:2.0:1789601528.415220:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158ac186 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158ac18d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789601528.415221:0:13055:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91edffe44800), last request at 1789601524 00000020:00000080:0.0:1789601528.415227:0:13055:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abd8f 00010000:00010000:2.0:1789601528.415233:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158ac186 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3d6e402158ac18d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789601528.415236:0:13055:0:(import.c:65:import_set_state_nolock()) ffff91edffe43000 : changing import state from FULL to CLOSED 10000000:00010000:2.0:1789601528.415244:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158ac186 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3d6e402158ac18d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789601528.415246:0:13055:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff91edffe44800): rc 0 00000020:00000080:0.0:1789601528.415251:0:13055:0:(genops.c:885:class_export_put()) final put ffff91edffe44800/lustre-MDT0000-lwp-OST0000_UUID 10000000:01000000:2.0:1789601528.415254:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789601528.415258:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789601528.415261:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000004:00000080:0.0:1789601528.415268:0:13055:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaf678161fae0 00010000:00010000:2.0:1789601528.415273:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158ac186 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158ac18d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601528.415280:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1789601528.415293:0:13055:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789601528.415299:0:13055:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00010000:00010000:2.0:1789601528.415300:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158ac186 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158ac18d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601528.415309:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc3b89200/0xf3d6e402158ac186 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158ac18d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789601528.415317:0:13055:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1789601528.415331:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601528.415334:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc3b88000/0xf3d6e402158abc46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158abc4d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601528.415340:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88000 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:2.0:1789601528.415344:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b88000/0xf3d6e402158abc46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158abc4d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601528.415362:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc3b88000/0xf3d6e402158abc46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3d6e402158abc4d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601528.415369:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b88000/0xf3d6e402158abc46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3d6e402158abc4d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601528.415374:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789601528.415376:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789601528.415378:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:0.0:1789601528.415385:0:13055:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:2.0:1789601528.415393:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc3b88000/0xf3d6e402158abc46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158abc4d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789601528.415400:0:13055:0:(import.c:65:import_set_state_nolock()) ffff91edc7b4b800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1789601528.415401:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601528.415413:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc3b88000/0xf3d6e402158abc46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158abc4d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789601528.415415:0:13055:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789601528.415419:0:13055:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00010000:00010000:2.0:1789601528.415425:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc3b88000/0xf3d6e402158abc46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158abc4d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789601528.415431:0:13055:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1789601528.415451:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601528.415454:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601528.415463:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601528.415483:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880563456:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789601528.415506:0:13055:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789601528.415533:0:13055:0:(import.c:65:import_set_state_nolock()) ffff91edf8ac5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789601528.415566:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789601528.415573:0:13055:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff91edd174cd40) has no exports 00000100:00100000:2.0:1789601528.415629:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601528.415636:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880563328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601528.415660:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601528.415714:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880563456 00000100:00100000:2.0:1789601528.415723:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880563456 00000100:00100000:2.0:1789601528.415776:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880563328 00000100:00100000:2.0:1789601528.415779:0:8437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880563328 00000100:00100000:3.0:1789601528.415920:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880563072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601528.415952:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601528.415967:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601528.415972:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880563200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601528.415992:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601528.416013:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880563072 00000100:00100000:3.0:1789601528.416017:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880563072 00000100:00100000:3.0:1789601528.416039:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880563200 00000100:00100000:3.0:1789601528.416042:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880563200 00000100:00100000:3.0:1789601528.416056:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789601528.416064:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+21:3320:x1876532880563456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789601528.416079:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601528.416095:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc3b89c00/0xf3d6e402158abc4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3d6e402158abc46 expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601528.416112:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601528.416153:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+20:3320:x1876532880563456:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601528.416161:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789601528.416180:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789601528.416187:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3320:x1876532880563328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789601528.416195:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789601528.416199:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1789601528.416205:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edffadd400/0xf3d6e402158ac18d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3d6e402158ac186 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601528.416212:0:8437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435644e3-9e9f-44ed-9cfe-21987eda72e5+19:3317:x1876532880563072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789601528.416218:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789601528.416223:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601528.416236:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edffadd200/0xf3d6e402158abf72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3d6e402158abf6b expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601528.416250:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601528.416254:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+17:3320:x1876532880563328:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601528.416262:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789601528.416278:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789601528.416287:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:3317:x1876532880563200:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601528.416292:0:8437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:435644e3-9e9f-44ed-9cfe-21987eda72e5+16:3317:x1876532880563072:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (336us total) trans 0 rc 0/0 00010000:00010000:3.0:1789601528.416298:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789601528.416302:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1789601528.416312:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc29c4600/0xf3d6e402158abe99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf3d6e402158abe92 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601528.416325:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601528.416349:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:3317:x1876532880563200:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601528.416355:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000020:00000080:3.0:1789601528.416377:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91ee00c8a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:2.0:1789601528.418243:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601528.418280:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf83bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880563584:0@lo:9:umount.0 00000100:00100000:2.0:1789601528.418398:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601528.418469:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880563712:0@lo:9:umount.0 00000100:00100000:2.0:1789601528.418523:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601528.418580:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880563584 00000100:00100000:2.0:1789601528.418593:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880563584 00000100:00100000:2.0:1789601528.418649:0:11670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880563712 00000100:00100000:2.0:1789601528.418660:0:11670:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880563712 00000100:00100000:2.0:1789601528.418719:0:11670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789601528.418730:0:11670:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3316:x1876532880563584:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789601528.418768:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91edffe44800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789601528.418782:0:11670:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abddc 00000020:00000080:3.0:1789601528.418818:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91ee00c8c000 for lustre-MDT0000 00000020:00000080:3.0:1789601528.418825:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91edffe43000 for lustre-MDT0000 00000100:00080000:3.0:1789601528.418977:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601528.419024:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880563200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601528.419037:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880563072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601528.419089:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880563328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601528.419101:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:435644e3-9e9f-44ed-9cfe-21987eda72e5:3320:1876532880563456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601528.419996:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789601528.420016:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3316:x1876532880563712:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789601528.420046:0:6677:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abec3 00000100:00080000:3.0:1789601528.420072:0:6677:0:(import.c:65:import_set_state_nolock()) ffff91edffe9c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789601528.420137:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:2.0:1789601528.420202:0:11670:0:(import.c:65:import_set_state_nolock()) ffff91edefee8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789601528.420239:0:11670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:0.0:1789601528.420634:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601528.420701:0:11670:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3316:x1876532880563584:12345-0@lo:9:umount.0 Request processed in 1972us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601528.420713:0:11670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1789601528.420739:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91edc7b4b800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:2.0:1789601528.420751:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789601528.420764:0:3316:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789601528.420768:0:3316:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789601528.420775:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf83bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880563584:0@lo:9:umount.0 00000100:00100000:3.0:1789601528.421177:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3316:x1876532880563712:12345-0@lo:9:umount.0 Request processed in 1169us (2652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601528.421185:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1789601528.421247:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91edf8ac5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789601528.421262:0:3316:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789601528.421265:0:3316:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789601528.421268:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880563712:0@lo:9:umount.0 00000020:00080000:2.0:1789601528.427372:0:13055:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff91edd174cd40) has no exports 00000020:00000080:2.0:1789601528.524716:0:13055:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abca1 00000020:00000080:2.0:1789601528.524732:0:13055:0:(genops.c:885:class_export_put()) final put ffff91ee008a7800/lustre-QMT0000_UUID 00000020:01000000:2.0:1789601528.524759:0:13055:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1789601528.524927:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ee008a7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789601528.524976:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789601528.524992:0:13055:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789601528.524997:0:13055:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff91edc71cb380) has no exports 00000020:00000080:3.0:1789601528.527056:0:13055:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abc9a 00000020:00000080:3.0:1789601528.527070:0:13055:0:(genops.c:885:class_export_put()) final put ffff91edf9d50800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789601528.527149:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789601528.527169:0:13055:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789601528.527172:0:13055:0:(genops.c:885:class_export_put()) final put ffff91edf795b000/lustre-QMT0000_UUID 00000020:00000080:3.0:1789601528.527175:0:13055:0:(genops.c:844:class_export_destroy()) destroying export ffff91edf795b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789601528.527182:0:13055:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1789601528.527323:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91edf9d50800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1789601528.841067:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601529.803168:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880563968:0@lo:400:kworker.0 00000100:00100000:0.0:1789601529.803240:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601529.803324:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601529.803331:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880563840:0@lo:400:kworker.0 00000100:00100000:0.0:1789601529.803363:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601529.803449:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876532880564096:0@lo:400:kworker.0 00000100:00100000:1.0:1789601529.803481:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601529.803565:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880563968 00000100:00100000:2.0:1789601529.803573:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880563968 00000100:00100000:2.0:1789601529.803611:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880564096 00000100:00100000:2.0:1789601529.803613:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880564096 00000100:00100000:2.0:1789601529.803632:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789601529.803671:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3318:x1876532880563968:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789601529.803679:0:5837:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789601529.803730:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3318:x1876532880563968:12345-0@lo:400:kworker.0 Request processed in 89us (488us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789601529.803737:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789601529.803752:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789601529.803756:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edc71a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3319:x1876532880564096:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789601529.803761:0:5837:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789601529.803782:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edc71a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3319:x1876532880564096:12345-0@lo:400:kworker.0 Request processed in 25us (301us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789601529.803805:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:1.0:1789601529.803892:0:3319:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789601529.803898:0:3319:0:(import.c:65:import_set_state_nolock()) ffff91edfb9ab000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789601529.803902:0:3319:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789601529.805039:0:3318:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789601529.805056:0:3318:0:(import.c:65:import_set_state_nolock()) ffff91edffe98800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789601529.805061:0:3318:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789601529.805067:0:3318:0:(import.c:65:import_set_state_nolock()) ffff91edffe98800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789601529.805071:0:3318:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 169 00000100:00080000:0.0:1789601529.805083:0:3318:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91edffe98800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1789601529.805114:0:3318:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ecc2ed2d80 x1876532880564224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789601529.805150:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880563968:0@lo:400:kworker.0 00000100:00100000:3.0:1789601529.805266:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880563840 00000100:00100000:3.0:1789601529.805274:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880563840 00000100:00100000:3.0:1789601529.805325:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1789601529.805334:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf2267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:3318:x1876532880563840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601529.805405:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf2267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:435644e3-9e9f-44ed-9cfe-21987eda72e5+14:3318:x1876532880563840:12345-0@lo:400:kworker.0 Request processed in 72us (2042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601529.805412:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1789601529.805492:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880563840:0@lo:400:kworker.0 00000100:00100000:2.0:1789601529.805683:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1876532880564224:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789601529.805810:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601529.805921:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880564224 00000100:00100000:0.0:1789601529.805926:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880564224 00000100:00100000:0.0:1789601529.805954:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789601529.805959:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1876532880564224:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1789601529.805974:0:5837:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1789601529.826209:0:3319:0:(import.c:65:import_set_state_nolock()) ffff91edfb9ab000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789601529.826223:0:3319:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 190 00000100:00080000:1.0:1789601529.826243:0:3319:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91edfb9ab000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1789601529.826304:0:3319:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ee00661880 x1876532880564352/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789601529.826357:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876532880564096:0@lo:400:kworker.0 00000100:00100000:2.0:1789601529.826664:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1876532880564352:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789601529.826763:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601529.827415:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880564352 00000100:00100000:1.0:1789601529.827427:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880564352 00000100:00100000:1.0:1789601529.827681:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789601529.827693:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3316:x1876532880564352:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789601529.827718:0:5839:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789601529.827890:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3316:x1876532880564352:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 199us (1128us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789601529.827920:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1789601529.828452:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91edfb9ab000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789601529.828460:0:3316:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789601529.828465:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1876532880564352:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1789601529.865066:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1876532880564224:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 59089us (59328us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789601529.865089:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00010000:00010000:2.0:1789601529.866686:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789601529.867705:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91edffe98800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789601529.867720:0:3316:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789601529.867960:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1876532880564224:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:2.0:1789601530.391308:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 85db4f7d-704a-4080-a137-b2930e072a8c 00000001:00080000:2.0:1789601530.391333:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1789601530.391341:0:5859:0:(genops.c:885:class_export_put()) final put ffff91ee002a7800/85db4f7d-704a-4080-a137-b2930e072a8c 00000020:00000080:2.0:1789601530.391372:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ee002a7800/85db4f7d-704a-4080-a137-b2930e072a8c for lustre-MDT0000 00000020:00000080:2.0:1789601530.391532:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91ee002a3800 for lustre-MDT0000 00000001:00100000:3.0:1789601530.413359:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789601530.413373:0:7635:0:(genops.c:885:class_export_put()) final put ffff91edffe9d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789601530.413459:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91edffe9d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789601530.413527:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91edffe9c800 for lustre-OST0001 00000020:01000000:0.0:1789601530.569069:0:13055:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91edc8b09240 - data ffff91edc7617288/ffff91edf7eca800 00000020:01000000:0.0:1789601530.569264:0:13055:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91edd8ad6a20 - data ffff91edc7457438/ffff91edc7bb7800 00000001:00000004:0.0:1789601530.575718:0:13055:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:0.0:1789601530.683294:0:13055:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789601530.683307:0:13055:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1789601530.683375:0:13055:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789601530.683379:0:13055:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789601530.685282:0:7008:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789601530.685293:0:7008:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1789601530.685306:0:7008:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789601530.687993:0:13055:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789601530.688004:0:13055:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1789601530.688044:0:13055:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789601530.688048:0:13055:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789601530.689316:0:8063:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789601530.689324:0:8063:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1789601530.689345:0:8063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789601530.777522:0:13055:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abc69 00000020:00000080:2.0:1789601530.777540:0:13055:0:(genops.c:885:class_export_put()) final put ffff91ee00c88000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789601530.777764:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ee00c88000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789601530.780179:0:13055:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abc7e 00000020:00000080:2.0:1789601530.780198:0:13055:0:(genops.c:885:class_export_put()) final put ffff91ee00c8a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789601530.780224:0:13055:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789601530.780231:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789601530.780242:0:13055:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789601530.780248:0:13055:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff91edd174b380) has no exports 00000020:00000080:0.0:1789601530.780444:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ee00c8a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1789601530.781335:0:13055:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789601530.781351:0:13055:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abebc 00000020:00000080:2.0:1789601530.781359:0:13055:0:(genops.c:885:class_export_put()) final put ffff91edffa40800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789601530.781407:0:13055:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789601530.781414:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789601530.781424:0:13055:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789601530.781427:0:13055:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff91edc6014d40) has no exports 00000020:00000080:2.0:1789601530.781451:0:13055:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abeb5 00000020:00000080:2.0:1789601530.781456:0:13055:0:(genops.c:885:class_export_put()) final put ffff91edf8ac3000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789601530.781530:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91edffa40800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1789601530.782226:0:13055:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789601530.782232:0:13055:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789601530.782237:0:13055:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1789601530.782246:0:13055:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789601530.782248:0:13055:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789601530.782294:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789601530.782304:0:13055:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789601530.782312:0:13055:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abdd5 00000020:00000080:2.0:1789601530.782319:0:13055:0:(genops.c:885:class_export_put()) final put ffff91edffe44000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789601530.782323:0:13055:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789601530.782329:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789601530.782333:0:13055:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789601530.782335:0:13055:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff91edc71c8000) has no exports 00000020:00000080:2.0:1789601530.782342:0:13055:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abdce 00000020:00000080:2.0:1789601530.782345:0:13055:0:(genops.c:885:class_export_put()) final put ffff91edc7b4d000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789601530.782802:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91edf8ac3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789601530.782814:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91edf8ac5000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789601530.782822:0:38:0:(genops.c:885:class_export_put()) final put ffff91ee00b0a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789601530.782824:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ee00b0a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789601530.782830:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789601530.783092:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91edffe44000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789601530.783098:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91edc7b4d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789601530.783232:0:13055:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789601530.783237:0:13055:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789601530.783240:0:13055:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1789601530.783245:0:13055:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789601530.783247:0:13055:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789601530.783296:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789601530.783303:0:13055:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789601530.783343:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789601530.783346:0:13055:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789601530.783350:0:13055:0:(genops.c:885:class_export_put()) final put ffff91edf793e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789601530.783352:0:13055:0:(genops.c:844:class_export_destroy()) destroying export ffff91edf793e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789601530.783357:0:13055:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789601530.783519:0:13055:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abc85 00000020:00000080:2.0:1789601530.783526:0:13055:0:(genops.c:885:class_export_put()) final put ffff91ee00c89000/lustre-MDD0000_UUID 00000020:01000000:2.0:1789601530.783540:0:13055:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789601530.783544:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789601530.783549:0:13055:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789601530.783551:0:13055:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff91edd1748000) has no exports 00000020:00000080:2.0:1789601530.783575:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789601530.783579:0:13055:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1789601530.783583:0:13055:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abc8c 00000020:00000080:2.0:1789601530.783587:0:13055:0:(genops.c:885:class_export_put()) final put ffff91ee00c8e000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789601530.783595:0:13055:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91edd1466000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1789601530.783599:0:13055:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91edd1466000 3 00000020:01000004:2.0:1789601530.783603:0:13055:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91edd1466000 from lustre-MDT0000 00000020:00000080:2.0:1789601530.783634:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789601530.783638:0:13055:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1789601530.783641:0:13055:0:(genops.c:885:class_export_put()) final put ffff91ee00c8e800/lustre-MDT0000_UUID 00000020:00000080:2.0:1789601530.783644:0:13055:0:(genops.c:844:class_export_destroy()) destroying export ffff91ee00c8e800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1789601530.783651:0:13055:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1789601530.783678:0:13055:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:00000080:0.0:1789601530.785261:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91edc7b4b800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789601530.785282:0:38:0:(genops.c:885:class_export_put()) final put ffff91edffe98000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789601530.785285:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91edffe98000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789601530.785294:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789601530.785434:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ee00c89000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789601530.785440:0:38:0:(genops.c:885:class_export_put()) final put ffff91ee00c8d000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789601530.785442:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ee00c8d000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789601530.785446:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789601530.785649:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ee00c8e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1789601530.787009:0:13055:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1789601530.787022:0:13055:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1789601530.787035:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789601530.787043:0:13055:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789601530.787053:0:13055:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff91edd8de1800 435644e3-9e9f-44ed-9cfe-21987eda72e5 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789601530.787062:0:13055:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff91edc71c99c0) has exports, disconnecting them 00000020:00080000:2.0:1789601530.787068:0:13055:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff91edd8de1800), last request at 1789601281 00000020:00000080:2.0:1789601530.787093:0:13055:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abc2a 00000020:00010000:2.0:1789601530.787102:0:13055:0:(genops.c:1920:obd_stale_export_put()) Put export ffff91edd8de1800: total 0 00000100:00080000:2.0:1789601530.787108:0:13055:0:(import.c:65:import_set_state_nolock()) ffff91edd8de4000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789601530.787180:0:13055:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff91edd8de1800): rc 0 00000020:00080000:2.0:1789601530.787187:0:13055:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff91edc71c99c0) has no exports 00000100:00100000:2.0:1789601530.787287:0:5832:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff91edc8a3a800:5832] 2 exiting: rc = 0 00000100:00100000:3.0:1789601530.789173:0:5831:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff91edc6320000:5831] 1 exiting: rc = 0 00000100:00100000:1.0:1789601530.790780:0:5830:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff91edd1725200:5830] 0 exiting: rc = 1 00000100:00100000:2.0:1789601530.791061:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791081:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791109:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791117:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791125:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791133:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791139:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791147:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791154:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791160:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791167:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791175:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791182:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791188:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791194:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791201:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791207:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791213:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791221:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791229:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791237:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791244:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791251:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791258:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791264:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791271:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791278:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791285:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791291:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791298:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791304:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791309:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791315:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791320:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791326:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791335:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791341:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791357:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791363:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791370:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791376:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791386:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791392:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791399:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791406:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791413:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791420:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791426:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791433:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791439:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791445:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791451:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791458:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791464:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791471:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791477:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791484:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791491:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791497:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791506:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791513:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791519:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791525:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601530.791531:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1789601530.792159:0:13055:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789601530.792165:0:13055:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:2.0:1789601530.793813:0:13055:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff91ee02044c00/0xf3d6e402158abd42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xf3d6e402158abd3b expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601530.794061:0:13055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ee02044c00/0xf3d6e402158abd42 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xf3d6e402158abd3b expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601530.794169:0:13055:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff91edffadcc00/0xf3d6e402158abf2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xf3d6e402158abf25 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601530.794182:0:13055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edffadcc00/0xf3d6e402158abf2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xf3d6e402158abf25 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601530.794192:0:13055:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abf3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xf3d6e402158abf33 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601530.794201:0:13055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc3b88400/0xf3d6e402158abf3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xf3d6e402158abf33 expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601530.794209:0:13055:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xf3d6e402158abf41 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601530.794216:0:13055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc29c4800/0xf3d6e402158abf48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xf3d6e402158abf41 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601530.794225:0:13055:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff91edffadd000/0xf3d6e402158abf56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xf3d6e402158abf4f expref: 5 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601530.794232:0:13055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edffadd000/0xf3d6e402158abf56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xf3d6e402158abf4f expref: 5 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601530.794251:0:13055:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff91edc3b89800/0xf3d6e402158abf80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xf3d6e402158abf79 expref: 4 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601530.794260:0:13055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc3b89800/0xf3d6e402158abf80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xf3d6e402158abf79 expref: 4 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601530.794273:0:13055:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff91edc3b88200/0xf3d6e402158ac171 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xf3d6e402158ac16a expref: 3 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601530.794283:0:13055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc3b88200/0xf3d6e402158ac171 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xf3d6e402158ac16a expref: 3 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601530.794291:0:13055:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff91edc3b89600/0xf3d6e402158ac17f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0xf3d6e402158ac178 expref: 2 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601530.794299:0:13055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc3b89600/0xf3d6e402158ac17f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0xf3d6e402158ac178 expref: 2 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:0.0:1789601530.794383:0:5825:0:(genops.c:1906:obd_stale_export_get()) Get export ffff91edd8de1800: total 0 00010000:00010000:1.0:1789601530.794824:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91edd8de1800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1789601530.795030:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91edd8de1800, canceled 0 locks, left on hash table 0. 00000020:00000080:1.0:1789601530.795044:0:5825:0:(genops.c:885:class_export_put()) final put ffff91edd8de1800/435644e3-9e9f-44ed-9cfe-21987eda72e5 00010000:00010000:1.0:1789601530.795068:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601530.795070:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601530.795072:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789601530.795111:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91edd8de1800/435644e3-9e9f-44ed-9cfe-21987eda72e5 for MGS 00000020:00000080:0.0:1789601530.795154:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91edd8de4000 for MGS 00010000:00010000:2.0:1789601530.889197:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601531.913561:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789601532.494234:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789601532.494251:0:6703:0:(genops.c:885:class_export_put()) final put ffff91edefeee800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789601532.494900:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91edefeee800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789601532.495001:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91edefee8000 for lustre-OST0000 00000020:01000000:1.0:1789601532.817534:0:13055:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91edc8b09f60 - data ffff91edf6e71af8/ffff91edf7ec8400 00000020:01000000:1.0:1789601532.817721:0:13055:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91edc7905b40 - data ffff91edde52c0d8/ffff91edc8a8ac00 00000020:00000080:1.0:1789601532.822686:0:13055:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abc0e 00000020:00000080:1.0:1789601532.822702:0:13055:0:(genops.c:885:class_export_put()) final put ffff91edd8de0000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789601532.824017:0:13055:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91edd1466000 from MGS, refs=2 00000020:01000004:1.0:1789601532.824023:0:13055:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91edd1466000 2 00000020:01000004:1.0:1789601532.824027:0:13055:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91edd1466000 from MGS 00000020:00000080:1.0:1789601532.824074:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789601532.824087:0:13055:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789601532.824091:0:13055:0:(genops.c:885:class_export_put()) final put ffff91edd8de6000/MGS 00000020:00000080:1.0:1789601532.824095:0:13055:0:(genops.c:844:class_export_destroy()) destroying export ffff91edd8de6000/MGS for MGS 00000020:01000000:1.0:1789601532.824103:0:13055:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789601532.824180:0:13055:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789601532.824185:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789601532.824194:0:13055:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789601532.824202:0:13055:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff91edf7938000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789601532.824210:0:13055:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff91edc82c99c0) has exports, disconnecting them 00000020:00080000:1.0:1789601532.824215:0:13055:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff91edf7938000), last request at 1789601281 00000020:00000080:1.0:1789601532.824221:0:13055:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abcd9 00000020:00080000:1.0:1789601532.824235:0:13055:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff91edf7938000): rc 0 00000020:00000080:1.0:1789601532.824242:0:13055:0:(genops.c:885:class_export_put()) final put ffff91edf7938000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789601532.827386:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91edd8de0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789601532.834534:0:13055:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789601532.834549:0:13055:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789601532.834555:0:13055:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789601532.834566:0:13055:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789601532.835063:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91edf7938000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789601532.835391:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789601532.835404:0:13055:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789601532.835413:0:13055:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91edd1466000 1 00000020:00000080:1.0:1789601532.835421:0:13055:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abc00 00000020:00000080:1.0:1789601532.835432:0:13055:0:(genops.c:885:class_export_put()) final put ffff91edd8de7800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789601532.835908:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91edf7938800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789601532.835942:0:38:0:(genops.c:885:class_export_put()) final put ffff91ee00c8b000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789601532.835945:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91ee00c8b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789601532.835952:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:1.0:1789601532.836142:0:13055:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789601532.836150:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789601532.836156:0:13055:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789601532.836162:0:13055:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff91edd17499c0) has no exports 00000020:00000080:0.0:1789601532.853742:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91edd8de7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789601532.865374:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789601532.865396:0:13055:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789601532.865404:0:13055:0:(genops.c:885:class_export_put()) final put ffff91edd8d6c000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789601532.865410:0:13055:0:(genops.c:844:class_export_destroy()) destroying export ffff91edd8d6c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789601532.865422:0:13055:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789601532.865599:0:13055:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91edd1467800 00000020:01000000:3.0:1789601532.865627:0:13055:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789601532.867018:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789601532.867034:0:13055:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789601532.867040:0:13055:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff91edc6053380) has no exports 00000100:00100000:2.0:1789601532.867455:0:8248:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff91edc7aa1400:8248] 3 exiting: rc = 0 00000100:00100000:3.0:1789601532.869053:0:5838:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff91edc7aa0200:5838] 1 exiting: rc = 0 00000100:00100000:1.0:1789601532.871916:0:5839:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff91edc8322a00:5839] 2 exiting: rc = 0 00000100:00100000:1.0:1789601532.872097:0:5837:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff91edc7aa0800:5837] 0 exiting: rc = 1 00000100:00100000:2.0:1789601532.874620:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874641:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874648:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874654:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874660:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874666:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874673:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874678:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874683:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874689:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874695:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874701:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874716:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874724:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874730:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874736:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874742:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874747:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874753:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874759:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874764:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874771:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874777:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874783:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874789:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874795:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874801:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874823:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874867:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874875:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874881:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874887:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874893:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874899:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874906:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874913:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874919:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874924:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874932:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874938:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874945:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874951:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874957:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874965:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874971:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874977:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874984:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874991:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.874997:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.875002:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.875009:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.875016:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.875022:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.875029:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.875036:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.875043:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.875050:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.875057:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.875064:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.875071:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.875079:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.875088:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.875096:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.875112:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601532.881277:0:5840:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff91edc8307e00:5840] 0 exiting: rc = 1 00000100:00100000:0.0:1789601532.881485:0:5841:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff91edc8322600:5841] 1 exiting: rc = 0 00000100:00100000:2.0:1789601532.881605:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881616:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881623:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881630:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881637:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881644:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881652:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881671:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881679:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881688:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881695:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881703:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881820:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881827:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881927:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881936:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881943:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881949:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881956:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881963:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881969:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881974:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881980:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881986:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881992:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.881998:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882003:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882009:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882014:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882019:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882025:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882031:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882037:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882043:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882065:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882071:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882077:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882083:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882088:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882094:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882100:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882107:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882113:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882119:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882125:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882132:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882138:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882144:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882150:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882156:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882162:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882169:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882176:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882183:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882190:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882196:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882202:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882209:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882215:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882221:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882228:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882234:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882240:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.882246:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601532.883074:0:5842:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff91edc8307000:5842] 0 exiting: rc = 1 00000100:00100000:0.0:1789601532.883265:0:5843:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff91edc8307600:5843] 1 exiting: rc = 0 00000100:00100000:2.0:1789601532.883412:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883420:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883427:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883433:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883450:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883503:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883509:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883515:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883522:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883528:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883535:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883541:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883548:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883554:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883561:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883571:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883603:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883611:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883617:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883624:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883631:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883639:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883646:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883653:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883660:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883666:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883812:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883823:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883978:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883988:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.883994:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884001:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884008:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884015:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884023:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884030:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884037:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884044:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884051:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884058:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884134:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884142:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884149:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884155:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884161:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884167:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884174:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884180:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884186:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884192:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884199:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884205:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884227:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884241:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884247:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884252:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884259:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884264:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884270:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884276:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884282:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884288:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884293:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.884300:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601532.916897:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff91edc8307c00:5844] 0 exiting: rc = 1 00000100:00100000:0.0:1789601532.917033:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff91edc5384200:5845] 1 exiting: rc = 0 00000100:00100000:2.0:1789601532.917310:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917321:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917328:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917334:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917339:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917345:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917350:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917356:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917361:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917367:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917372:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917394:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917399:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917404:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917410:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917414:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917419:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917425:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917430:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917435:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917440:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917446:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917451:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917456:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917461:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917466:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917472:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917477:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917482:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917487:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917492:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917497:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917502:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917508:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917513:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917518:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917525:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917530:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917536:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917541:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917546:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917552:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917556:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917561:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917566:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917571:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917597:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917603:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917608:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917614:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917619:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917624:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917630:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917635:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917641:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917646:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917652:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917658:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917664:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917670:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917675:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917681:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917687:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.917693:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.919492:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff91edc5384c00:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1789601532.919690:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff91edc5384a00:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1789601532.919800:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.919807:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.919813:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.919818:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.919824:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.919828:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.919834:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.919897:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.919902:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.919907:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.919913:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.919919:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.919925:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.919931:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.919937:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.919943:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.919968:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.919974:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920108:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920115:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920121:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920127:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920134:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920140:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920146:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920152:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920157:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920163:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920169:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920178:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920183:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920189:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920195:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920201:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920206:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920212:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920217:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920224:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920230:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920236:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920244:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920250:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920256:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920262:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920269:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920274:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920281:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920286:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920292:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920297:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920303:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920318:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920324:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920329:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920336:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920342:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920349:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920355:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920361:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920367:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920373:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920378:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920384:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.920389:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601532.923171:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff91edc6068000:5848] 0 exiting: rc = 1 00000100:00100000:2.0:1789601532.923610:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff91edc6069c00:5849] 1 exiting: rc = 0 00000100:00100000:2.0:1789601532.923694:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923704:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923711:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923717:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923723:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923728:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923734:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923739:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923745:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923751:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923757:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923762:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923767:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923773:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923787:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923793:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923798:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923804:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923810:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923815:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923821:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923882:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923888:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923894:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923900:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923906:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923911:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923917:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923923:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923929:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923936:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923941:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923946:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923951:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923958:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923963:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923969:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.923975:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924274:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924281:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924286:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924292:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924297:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924303:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924309:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924315:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924322:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924327:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924332:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924338:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924343:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924349:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924354:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924360:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924366:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924372:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924388:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924393:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924399:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924405:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924410:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924415:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924421:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.924427:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601532.925344:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff91edf20c5400:5852] 2 exiting: rc = 0 00000100:00100000:2.0:1789601532.925645:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff91edc8ac5800:5851] 1 exiting: rc = 0 00000100:00100000:3.0:1789601532.926093:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff91edc8ac5a00:5850] 0 exiting: rc = 1 00000100:00100000:2.0:1789601532.926680:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926689:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926696:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926703:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926709:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926715:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926721:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926727:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926733:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926739:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926746:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926752:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926759:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926765:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926771:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926776:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926782:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926788:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926794:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926821:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926829:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926852:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926859:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926865:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926871:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926877:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926900:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926906:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926915:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926923:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926930:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926936:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926945:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926953:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926960:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926967:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.926974:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927335:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927342:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927347:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927353:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927359:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927367:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927395:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927403:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927410:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927417:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927423:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927429:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927436:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927443:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927450:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927456:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927463:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927469:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927476:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927482:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927490:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927496:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927503:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927509:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927528:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927535:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601532.927542:0:13055:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1789601532.938175:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789601532.944479:0:13055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789601532.944498:0:13055:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789601532.944506:0:13055:0:(genops.c:885:class_export_put()) final put ffff91edc601d800/MDS_uuid 00000020:00000080:3.0:1789601532.944512:0:13055:0:(genops.c:844:class_export_destroy()) destroying export ffff91edc601d800/MDS_uuid for MDS 00000020:01000000:3.0:1789601532.944521:0:13055:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789601532.944783:0:13055:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1789601533.962100:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789601534.930124:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789601534.930135:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789601534.930142:0:38:0:(import.c:65:import_set_state_nolock()) ffff91edffe98800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789601534.930172:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 399 00000100:00080000:3.0:1789601534.930180:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789601534.930197:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91edffe98800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1789601534.930229:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91edf8b1fb80 x1876532880564608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789601534.930262:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789601534.930266:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789601534.930268:0:38:0:(import.c:65:import_set_state_nolock()) ffff91edfb9ab000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789601534.930271:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 399 00000100:00080000:3.0:1789601534.930274:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789601534.930279:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91edfb9ab000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1789601534.930291:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91edf8b1f800 x1876532880564736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789601534.930331:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1876532880564608:0@lo:38:kworker.0 00000400:00000100:3.0:1789601534.930400:0:3316:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876532880564608 offset 0 length 520: 4 00000100:00100000:3.0:1789601534.930464:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1876532880564736:0@lo:38:kworker.0 00000400:00000100:3.0:1789601534.930482:0:3316:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876532880564736 offset 0 length 520: 4 00000100:00100000:1.0:1789601534.931086:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601534.931102:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880564480:0@lo:400:kworker.0 00000400:00000100:1.0:1789601534.931142:0:3319:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876532880564480 offset 0 length 224: 4 00010000:00010000:0.0:1789601534.985090:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601536.008996:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789601536.465025:0:13210:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789601536.480234:0:13210:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789601536.480301:0:13210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadda00/0xf3d6e402158abf41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf48 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601536.480321:0:13210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadda00/0xf3d6e402158abf41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abf48 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601536.480329:0:13210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadda00/0xf3d6e402158abf41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158abf48 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601536.480335:0:13210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff91edffadda00/0xf3d6e402158abf41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158abf48 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601536.480359:0:13210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789601536.480365:0:13210:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789601536.480392:0:13210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789601536.480407:0:13210:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91edf8b1fb80 x1876532880564608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789601549 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601536.480448:0:13210:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789601536.480456:0:13210:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789601536.480464:0:13210:0:(import.c:65:import_set_state_nolock()) ffff91edffe98800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789601536.480470:0:13210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789601536.480474:0:13210:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91edf8b1fb80 x1876532880564608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789601549 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601536.480481:0:13210:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789601536.480484:0:13210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:1.0:1789601536.480932:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601536.480942:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edffadda00/0xf3d6e402158abf41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158abf48 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601536.480951:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadda00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601536.480955:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edffadda00/0xf3d6e402158abf41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158abf48 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601536.480964:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edffadda00/0xf3d6e402158abf41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3d6e402158abf48 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601536.480973:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edffadda00/0xf3d6e402158abf41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3d6e402158abf48 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601536.480979:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789601536.480982:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789601536.480985:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789601536.481035:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edffadda00/0xf3d6e402158abf41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158abf48 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601536.481043:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601536.481084:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edffadda00/0xf3d6e402158abf41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158abf48 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601536.481092:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edffadda00/0xf3d6e402158abf41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158abf48 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601536.481114:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601536.481116:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601536.481118:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601536.481240:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789601536.481261:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880564864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601536.481350:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601536.481434:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880564864 00000100:00100000:1.0:1789601536.481443:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880564864 00000100:00100000:1.0:1789601536.481492:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789601536.481501:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00661f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3318:x1876532880564864:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789601536.481508:0:5824:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789601536 with bad export cookie 17570481693835050026 00000100:00100000:3.0:1789601536.483803:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1876532880564608:0@lo:38:kworker.0 00010000:00010000:0.0:1789601536.485537:0:13210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abf4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601536.485563:0:13210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abf4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abf56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601536.485572:0:13210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abf4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158abf56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601536.485579:0:13210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abf4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158abf56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601536.485620:0:13210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789601536.485631:0:13210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158ac178 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac17f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601536.485639:0:13210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158ac178 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ac17f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601536.485646:0:13210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158ac178 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158ac17f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601536.485673:0:13210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158ac178 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158ac17f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601536.485700:0:13210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789601536.485706:0:13210:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789601536.485736:0:13210:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789601536.485743:0:13210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789601536.485748:0:13210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789601536.485755:0:13210:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789601536.485761:0:13210:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff91edc6054d40) has no exports 00000020:00080000:0.0:1789601536.485794:0:13210:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff91edc6054d40) has no exports 00010000:00010000:3.0:1789601536.486279:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789601536.486287:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abf4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158abf56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601536.486293:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0031c00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:3.0:1789601536.486297:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abf4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158abf56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601536.486313:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abf4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3d6e402158abf56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601536.486319:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abf4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3d6e402158abf56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601536.486324:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789601536.486325:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1789601536.486327:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1789601536.486368:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abf4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158abf56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601536.486371:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789601536.486397:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abf4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158abf56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601536.486401:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc0031c00/0xf3d6e402158abf4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158abf56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601536.486419:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601536.486421:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158ac178 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158ac17f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601536.486425:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadde00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:3.0:1789601536.486427:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158ac178 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158ac17f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601536.486431:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158ac178 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3d6e402158ac17f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601536.486442:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158ac178 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3d6e402158ac17f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601536.486446:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789601536.486447:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789601536.486449:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789601536.486457:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158ac178 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158ac17f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601536.486460:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789601536.486474:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158ac178 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158ac17f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601536.486479:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edffadde00/0xf3d6e402158ac178 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf3d6e402158ac17f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601536.486487:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601536.486488:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601536.486489:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601536.486497:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601536.486516:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880564992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601536.487046:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601536.487122:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880565120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601536.488290:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601536.488364:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880564992 00000100:00100000:3.0:1789601536.488373:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880564992 00000100:00100000:3.0:1789601536.488408:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880565120 00000100:00100000:3.0:1789601536.488409:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880565120 00000100:00100000:3.0:1789601536.488419:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789601536.488443:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede51e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3317:x1876532880564992:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789601536.488450:0:5822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789601536 with bad export cookie 17570481693835050026 00000100:00100000:3.0:1789601536.488496:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede51e0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3317:x1876532880564992:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (1451us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789601536.488502:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789601536.488516:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789601536.488529:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3319:x1876532880565120:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789601536.488534:0:5822:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789601536 with bad export cookie 17570481693835050026 00000100:00100000:3.0:1789601536.488567:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3319:x1876532880565120:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (280us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789601536.488573:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1789601536.493370:0:3317:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789601536.493381:0:3317:0:(import.c:65:import_set_state_nolock()) ffff91edd8b83000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789601536.493387:0:3317:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1789601536.494976:0:3319:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:01000000:0.0:1789601536.495438:0:13210:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91edf80cbf00 - data ffff91edc77f51b0/ffff91ee00bbc800 00010000:00010000:1.0:1789601536.495903:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789601536.496079:0:13210:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91edc8afe3c0 - data ffff91edc7742360/ffff91edc7a2cc00 00000100:00100000:1.0:1789601536.498311:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00661f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3318:x1876532880564864:12345-0@lo:103:ldlm_bl.0 Request processed in 16798us (16950us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789601536.498330:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1789601536.498423:0:3318:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789601536.510318:0:3317:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.130@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789601536.510326:0:3317:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789601536.510340:0:3317:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91edf8b1df80 x1876532880564480/t0(0) o400->MGC192.168.201.130@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789601550 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601536.510361:0:3317:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91ee00663100 x1876532880564864/t0(0) o103->MGC192.168.201.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789601552 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601536.510372:0:3317:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91edf8b1fb80 x1876532880564992/t0(0) o103->MGC192.168.201.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789601552 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601536.510382:0:3317:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91edf8b1d880 x1876532880565120/t0(0) o103->MGC192.168.201.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789601552 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789601536.510412:0:3319:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff91edd8b83000 already not connected (conn 1, was 1): DISCONN 10000000:01000000:3.0:1789601536.510418:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789601536.510421:0:3317:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789601536.510423:0:3317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789601536.510449:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880564480:0@lo:400:kworker.0 00000100:00080000:3.0:1789601536.510453:0:3317:0:(import.c:65:import_set_state_nolock()) ffff91edd8b83000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789601536.510458:0:3317:0:(import.c:545:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 151 00000100:00080000:3.0:1789601536.510482:0:3317:0:(import.c:666:import_select_connection()) MGC192.168.201.130@tcp: import ffff91edd8b83000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:3.0:1789601536.510531:0:3317:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91edf8b1d500 x1876532880565248/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789601536.510535:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:435644e3-9e9f-44ed-9cfe-21987eda72e5:3319:1876532880565120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601536.510578:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:435644e3-9e9f-44ed-9cfe-21987eda72e5:3317:1876532880564992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789601536.510813:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:435644e3-9e9f-44ed-9cfe-21987eda72e5:3316:1876532880565248:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1789601536.510911:0:3316:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876532880565248 offset 0 length 520: 4 00000100:00080000:1.0:1789601536.512401:0:3318:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff91edd8b83000 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1789601536.512420:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:435644e3-9e9f-44ed-9cfe-21987eda72e5:3318:1876532880564864:0@lo:103:ldlm_bl.0 00100000:10000000:1.0:1789601536.532976:0:13210:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789601536.586597:0:13210:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abd5e 00000020:00000080:3.0:1789601536.586613:0:13210:0:(genops.c:885:class_export_put()) final put ffff91edffa44000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789601536.586648:0:13210:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91edc825a800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789601536.586653:0:13210:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91edc825a800 2 00000020:01000004:3.0:1789601536.586658:0:13210:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91edc825a800 from lustre-OST0000 00000020:00000080:3.0:1789601536.586689:0:13210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789601536.586703:0:13210:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789601536.586706:0:13210:0:(genops.c:885:class_export_put()) final put ffff91edffa40000/lustre-OST0000_UUID 00000020:00000080:3.0:1789601536.586709:0:13210:0:(genops.c:844:class_export_destroy()) destroying export ffff91edffa40000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789601536.586717:0:13210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789601536.586768:0:13210:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789601536.586772:0:13210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789601536.586777:0:13210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789601536.586782:0:13210:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789601536.586790:0:13210:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff91edffe9f800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789601536.586797:0:13210:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff91edc71ccd40) has exports, disconnecting them 00000020:00080000:3.0:1789601536.586803:0:13210:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff91edffe9f800), last request at 1789601299 00000020:00000080:3.0:1789601536.586808:0:13210:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abd88 00000020:00080000:3.0:1789601536.586816:0:13210:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff91edffe9f800): rc 0 00000020:00000080:3.0:1789601536.586822:0:13210:0:(genops.c:885:class_export_put()) final put ffff91edffe9f800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789601536.588074:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91edffa44000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789601536.588103:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91edffe9f800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789601536.589034:0:13210:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789601536.589043:0:13210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789601536.589049:0:13210:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789601536.589058:0:13210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789601536.589179:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91edffe98800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789601536.589314:0:13210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789601536.589323:0:13210:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789601536.589340:0:13210:0:(genops.c:885:class_export_put()) final put ffff91edfb9aa800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789601536.589343:0:13210:0:(genops.c:844:class_export_destroy()) destroying export ffff91edfb9aa800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789601536.589349:0:13210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789601536.589412:0:13210:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91edc825a800 1 00000020:00000080:0.0:1789601536.589431:0:13210:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abd18 00000020:00000080:0.0:1789601536.589439:0:13210:0:(genops.c:885:class_export_put()) final put ffff91edf87e5800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789601536.589450:0:13210:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789601536.589456:0:13210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789601536.589462:0:13210:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789601536.589467:0:13210:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff91edc82cb380) has no exports 00000020:00000080:1.0:1789601536.589480:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff91edf87e5800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789601536.626165:0:13210:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789601536.626188:0:13210:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789601536.626196:0:13210:0:(genops.c:885:class_export_put()) final put ffff91edc825d800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789601536.626226:0:13210:0:(genops.c:844:class_export_destroy()) destroying export ffff91edc825d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789601536.626244:0:13210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789601536.626425:0:13210:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91edc825b000 00000020:02000400:3.0:1789601536.626483:0:13210:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789601537.033210:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601538.059951:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601539.085936:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789601539.717789:0:13359:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789601539.740306:0:13359:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789601539.740423:0:13359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5600/0xf3d6e402158abf25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601539.741340:0:13359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5600/0xf3d6e402158abf25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abf2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601539.741350:0:13359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5600/0xf3d6e402158abf25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158abf2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601539.741358:0:13359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff91edc29c5600/0xf3d6e402158abf25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158abf2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601539.741385:0:13359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789601539.741393:0:13359:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789601539.742418:0:13359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1789601539.742887:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601539.742900:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc29c5600/0xf3d6e402158abf25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158abf2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601539.742913:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5600 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:2.0:1789601539.742918:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c5600/0xf3d6e402158abf25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158abf2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601539.742930:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc29c5600/0xf3d6e402158abf25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3d6e402158abf2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601539.742938:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c5600/0xf3d6e402158abf25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3d6e402158abf2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601539.742944:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789601539.742947:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789601539.742952:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789601539.742975:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91edd8b83000 00010000:00010000:2.0:1789601539.742979:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc29c5600/0xf3d6e402158abf25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3d6e402158abf2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601539.742986:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc29c5600/0xf3d6e402158abf25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3d6e402158abf2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601539.743030:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601539.743031:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601539.743034:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601539.743155:0:13359:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91edf8b1f800 x1876532880564736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789601549 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601539.743177:0:13359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789601539.743187:0:13359:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789601539.743196:0:13359:0:(import.c:65:import_set_state_nolock()) ffff91edfb9ab000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789601539.743203:0:13359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789601539.743206:0:13359:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91edf8b1f800 x1876532880564736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789601549 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601539.743228:0:13359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789601539.743233:0:13359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:2.0:1789601539.744648:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1876532880564736:0@lo:38:kworker.0 00010000:00010000:0.0:1789601539.747723:0:13359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadd800/0xf3d6e402158abf33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158abf3a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601539.747748:0:13359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadd800/0xf3d6e402158abf33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158abf3a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601539.747758:0:13359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadd800/0xf3d6e402158abf33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158abf3a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601539.747766:0:13359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff91edffadd800/0xf3d6e402158abf33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158abf3a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601539.747802:0:13359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789601539.747811:0:13359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ac16a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ac171 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601539.747817:0:13359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ac16a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ac171 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601539.747824:0:13359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ac16a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158ac171 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601539.747831:0:13359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ac16a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf3d6e402158ac171 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601539.748267:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601539.748278:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edffadd800/0xf3d6e402158abf33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158abf3a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601539.748286:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadd800 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:3.0:1789601539.748291:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edffadd800/0xf3d6e402158abf33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158abf3a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601539.748300:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edffadd800/0xf3d6e402158abf33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3d6e402158abf3a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601539.748309:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edffadd800/0xf3d6e402158abf33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3d6e402158abf3a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601539.748315:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789601539.748318:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1789601539.748333:0:5825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91edd8b83000 00010000:00010000:3.0:1789601539.748338:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edffadd800/0xf3d6e402158abf33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3d6e402158abf3a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601539.748345:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edffadd800/0xf3d6e402158abf33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3d6e402158abf3a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601539.748366:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601539.748368:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601539.748388:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601539.749610:0:13359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789601539.749621:0:13359:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1789601539.749640:0:13359:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789601539.749677:0:13359:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789601539.749683:0:13359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789601539.749690:0:13359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789601539.749697:0:13359:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789601539.749704:0:13359:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff91edc6013380) has no exports 00000020:00080000:0.0:1789601539.749737:0:13359:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff91edc6013380) has no exports 00010000:00010000:3.0:1789601539.750820:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601539.750851:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ac16a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158ac171 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601539.750864:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89400 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:3.0:1789601539.750869:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ac16a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf3d6e402158ac171 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601539.750881:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ac16a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3d6e402158ac171 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601539.750890:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ac16a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3d6e402158ac171 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601539.750896:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789601539.750899:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789601539.750902:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789601539.750920:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91edd8b83000 00010000:00010000:3.0:1789601539.750924:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ac16a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3d6e402158ac171 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601539.750931:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ac16a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3d6e402158ac171 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601539.750951:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601539.750953:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601539.750955:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789601539.753287:0:13359:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91edf80cba80 - data ffff91edc77f5bd0/ffff91ee00b15400 00000020:01000000:0.0:1789601539.753718:0:13359:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91edc8b090c0 - data ffff91edf6e711b0/ffff91ee00b16000 00100000:10000000:0.0:1789601539.764572:0:13359:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789601539.790065:0:13359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abe29 00000020:00000080:3.0:1789601539.790080:0:13359:0:(genops.c:885:class_export_put()) final put ffff91edc8259800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789601539.790100:0:13359:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91edc7b4a800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789601539.790125:0:13359:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91edc7b4a800 2 00000020:01000004:3.0:1789601539.790129:0:13359:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91edc7b4a800 from lustre-OST0001 00000020:00000080:3.0:1789601539.790166:0:13359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789601539.790179:0:13359:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789601539.790183:0:13359:0:(genops.c:885:class_export_put()) final put ffff91edffe9b800/lustre-OST0001_UUID 00000020:00000080:3.0:1789601539.790186:0:13359:0:(genops.c:844:class_export_destroy()) destroying export ffff91edffe9b800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789601539.790195:0:13359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789601539.790330:0:13359:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 435644e3-9e9f-44ed-9cfe-21987eda72e5->MGS 00010000:00010000:3.0:1789601539.790353:0:13359:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc29c4c00/0xf3d6e402158abd3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3d6e402158abd42 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601539.790369:0:13359:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c4c00/0xf3d6e402158abd3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3d6e402158abd42 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601539.790376:0:13359:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789601539.790379:0:13359:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789601539.790383:0:13359:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789601539.790403:0:13359:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91edd8b83000 00010000:00010000:3.0:1789601539.790409:0:13359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc29c4c00/0xf3d6e402158abd3b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3d6e402158abd42 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601539.790442:0:13359:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edffadc000/0xf3d6e402158abf79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf3d6e402158abf80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601539.790449:0:13359:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edffadc000/0xf3d6e402158abf79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf3d6e402158abf80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601539.790455:0:13359:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789601539.790457:0:13359:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789601539.790459:0:13359:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789601539.790478:0:13359:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91edd8b83000 00010000:00010000:3.0:1789601539.790482:0:13359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edffadc000/0xf3d6e402158abf79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf3d6e402158abf80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789601539.790509:0:13359:0:(import.c:65:import_set_state_nolock()) ffff91edd8b83000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789601539.790514:0:13359:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789601539.790517:0:13359:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789601539.790519:0:13359:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789601539.790525:0:13359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789601539.790541:0:13359:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91edf8b1d500 x1876532880565248/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789601546 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789601539.790567:0:13359:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789601539.790571:0:13359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:1.0:1789601539.790701:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91edc8259800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1789601539.790896:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:435644e3-9e9f-44ed-9cfe-21987eda72e5:3316:1876532880565248:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:3.0:1789601539.791007:0:13359:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789601539.791016:0:13359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abc1c 00000020:00000080:3.0:1789601539.791021:0:13359:0:(genops.c:885:class_export_put()) final put ffff91edc601e800/435644e3-9e9f-44ed-9cfe-21987eda72e5 00000020:01000000:3.0:1789601539.791067:0:13359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.130@tcp (flags='') 00000020:00000080:3.0:1789601539.791075:0:13359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789601539.791081:0:13359:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.130@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789601539.791085:0:13359:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff91edc6010000) has no exports 10000000:01000000:0.0:1789601539.791313:0:5834:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789601539.791414:0:13359:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.130@tcp: client import never connected 00000100:00080000:3.0:1789601539.791418:0:13359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789601539.791420:0:13359:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789601539.791422:0:13359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789601539.791436:0:13359:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789601539.791477:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91edc601e800/435644e3-9e9f-44ed-9cfe-21987eda72e5 for MGC192.168.201.130@tcp 00000020:00000080:3.0:1789601539.791795:0:13359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789601539.791804:0:13359:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.130@tcp (uuid 435644e3-9e9f-44ed-9cfe-21987eda72e5) 00000020:01000000:3.0:1789601539.791813:0:13359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789601539.791817:0:13359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789601539.791821:0:13359:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789601539.791827:0:13359:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff91edffa42800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789601539.791833:0:13359:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff91edc60519c0) has exports, disconnecting them 00000020:00080000:3.0:1789601539.791869:0:13359:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff91edffa42800), last request at 1789601320 00000020:00000080:3.0:1789601539.791875:0:13359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abe53 00000020:00080000:3.0:1789601539.791900:0:13359:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff91edffa42800): rc 0 00000020:00000080:3.0:1789601539.791905:0:13359:0:(genops.c:885:class_export_put()) final put ffff91edffa42800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789601539.792990:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91edd8b83000 for MGC192.168.201.130@tcp 00000020:00000080:1.0:1789601539.793015:0:36:0:(genops.c:885:class_export_put()) final put ffff91edd8b84000/435644e3-9e9f-44ed-9cfe-21987eda72e5 00000020:00000080:1.0:1789601539.793018:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91edd8b84000/435644e3-9e9f-44ed-9cfe-21987eda72e5 for MGC192.168.201.130@tcp 00000020:01000000:1.0:1789601539.793035:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.130@tcp (435644e3-9e9f-44ed-9cfe-21987eda72e5) 00000020:00000080:1.0:1789601539.793337:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91edffa42800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789601539.799449:0:13359:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789601539.799473:0:13359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789601539.799479:0:13359:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789601539.799491:0:13359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789601539.799555:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91edfb9ab000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1789601539.799611:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789601539.800018:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1789601539.800144:0:5820:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff91edc8274c00:5820] 0 exiting: rc = 1 00000100:00100000:1.0:1789601539.800264:0:5821:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff91edc8274e00:5821] 1 exiting: rc = 0 00000100:00100000:0.0:1789601539.800419:0:7625:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff91edf845ce00:7625] 2 exiting: rc = 0 00000100:00100000:3.0:1789601539.800497:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.800798:0:8437:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff91edffb51600:8437] 3 exiting: rc = 0 00000100:00100000:3.0:1789601539.800888:0:5823:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff91ede00f9200:5823] 1 exiting: rc = 0 00000100:00100000:1.0:1789601539.801071:0:5822:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff91ede00f8c00:5822] 0 exiting: rc = 1 00000100:00100000:0.0:1789601539.806162:0:5824:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff91ede00f8600:5824] 2 exiting: rc = 0 00000100:00100000:3.0:1789601539.806321:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806333:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806354:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806361:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806367:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806374:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806381:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806390:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806399:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806406:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806413:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806420:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806436:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806442:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806449:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806455:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806558:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806568:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806574:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806580:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806699:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806706:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806713:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806732:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806738:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806744:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806751:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806757:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.806764:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807369:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807377:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807382:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807388:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807394:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807400:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807407:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807413:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807419:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807426:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807902:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807914:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807920:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807926:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807934:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807941:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807947:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807954:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807959:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807964:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807970:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807975:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807980:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807986:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807992:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.807998:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.808004:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.808010:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.808015:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.808032:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.808038:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.808044:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.808050:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.808056:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.808064:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789601539.817261:0:13359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789601539.817282:0:13359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789601539.817290:0:13359:0:(genops.c:885:class_export_put()) final put ffff91edffa43800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789601539.817297:0:13359:0:(genops.c:844:class_export_destroy()) destroying export ffff91edffa43800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789601539.817314:0:13359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1789601539.817396:0:13359:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91edc7b4a800 1 00000020:00000080:3.0:1789601539.817405:0:13359:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf3d6e402158abdf8 00000020:00000080:3.0:1789601539.817414:0:13359:0:(genops.c:885:class_export_put()) final put ffff91edefeec000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789601539.817648:0:13359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789601539.817655:0:13359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789601539.817662:0:13359:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789601539.817666:0:13359:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff91edc6050000) has no exports 00000020:00000080:1.0:1789601539.817771:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff91edefeec000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789601539.894535:0:13359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789601539.894565:0:13359:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1789601539.894574:0:13359:0:(genops.c:885:class_export_put()) final put ffff91edc7b48000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1789601539.894657:0:13359:0:(genops.c:844:class_export_destroy()) destroying export ffff91edc7b48000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1789601539.894676:0:13359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1789601539.895076:0:13359:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91edc7b49000 00000020:01000000:1.0:1789601539.895103:0:13359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1789601539.895109:0:13359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789601539.895115:0:13359:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789601539.895120:0:13359:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff91edc60119c0) has no exports 00000020:00000080:1.0:1789601539.895146:0:13359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789601539.895153:0:13359:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1789601539.895156:0:13359:0:(genops.c:885:class_export_put()) final put ffff91edf87e3000/OSS_uuid 00000020:00000080:1.0:1789601539.895159:0:13359:0:(genops.c:844:class_export_destroy()) destroying export ffff91edf87e3000/OSS_uuid for OSS 00000020:01000000:1.0:1789601539.895162:0:13359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1789601539.895341:0:5833:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789601539.896735:0:6676:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff91ede025b400:6676] 0 exiting: rc = 1 00000100:00100000:2.0:1789601539.897002:0:11670:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff91edffe1be00:11670] 3 exiting: rc = 0 00000100:00100000:3.0:1789601539.897236:0:6677:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff91eddedaa600:6677] 1 exiting: rc = 0 00000100:00100000:3.0:1789601539.898166:0:6679:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff91eddedabc00:6679] 2 exiting: rc = 0 00000100:00100000:1.0:1789601539.907029:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907044:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907052:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907060:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907065:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907071:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907077:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907083:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907111:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907118:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907124:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907130:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907136:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907142:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907148:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907153:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907161:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907167:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907172:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907178:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907183:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907189:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907194:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907199:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907205:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907210:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907215:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907221:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907226:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907232:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907237:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907244:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907251:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907256:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907262:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907268:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907274:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907280:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907285:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907291:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907297:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907302:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907307:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907319:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907325:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907331:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907336:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907342:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907350:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907356:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907361:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907369:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907374:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907380:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907390:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907395:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907400:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907405:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907410:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907416:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907422:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907721:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907727:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.907733:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789601539.910144:0:10225:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff91edf7f0e600:10225] 2 exiting: rc = 0 00000100:00100000:3.0:1789601539.914745:0:6681:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff91edf8765e00:6681] 1 exiting: rc = 0 00000100:00100000:2.0:1789601539.915636:0:6680:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff91edf8765a00:6680] 0 exiting: rc = 1 00000100:00100000:0.0:1789601539.920095:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920111:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920117:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920124:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920129:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920135:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920141:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920147:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920152:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920157:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920162:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920168:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920173:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920179:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920186:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920192:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920311:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920317:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920322:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920329:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920334:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920339:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920344:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920349:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920353:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920358:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920362:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920367:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920372:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920376:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920381:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920386:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920391:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920395:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920400:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920406:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920410:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920414:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920419:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920423:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920437:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920442:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920446:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920452:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920457:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920470:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920476:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920482:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920487:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920493:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920498:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920513:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920520:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920531:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920538:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920543:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920549:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920554:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920560:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920565:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920570:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920574:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.920579:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.921767:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.925092:0:6684:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff91edf8764c00:6684] 2 exiting: rc = 0 00000100:00100000:0.0:1789601539.925098:0:6683:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff91edf8764e00:6683] 1 exiting: rc = 0 00000100:00100000:0.0:1789601539.925337:0:12049:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_003: service thread [ffff91edcbc5d800:12049] 3 exiting: rc = 0 00000100:00100000:1.0:1789601539.926418:0:6682:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff91edf8764200:6682] 0 exiting: rc = 1 00000100:00100000:2.0:1789601539.928059:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928068:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928073:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928077:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928082:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928086:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928091:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928096:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928101:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928105:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928108:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928113:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928116:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928120:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928124:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928128:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928132:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928136:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928140:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928144:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928148:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928152:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928174:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928185:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928191:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928195:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928978:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928985:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928990:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928994:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.928999:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929004:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929009:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929013:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929017:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929020:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929024:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929028:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929033:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929038:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929043:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929048:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929053:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929058:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929062:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929067:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929071:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929091:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929095:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929099:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929103:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929107:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929111:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929115:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929119:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929123:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929130:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929142:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929157:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929162:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929167:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929171:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929176:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.929182:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789601539.944316:0:6685:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff91edf8765000:6685] 0 exiting: rc = 1 00000100:00100000:2.0:1789601539.947481:0:6686:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff91edf8765600:6686] 1 exiting: rc = 0 00000100:00100000:3.0:1789601539.948116:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948127:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948133:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948140:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948145:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948152:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948159:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948165:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948170:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948176:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948181:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948382:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948389:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948395:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948401:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948407:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948414:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948420:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948427:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948433:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948438:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948444:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948450:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948456:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948476:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948482:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948488:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948494:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948500:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948506:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948512:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948519:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948526:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948531:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948538:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948543:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948549:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948555:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948561:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948567:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948573:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948578:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948583:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948589:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948595:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948601:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948617:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948623:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948629:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948635:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948641:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948648:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948655:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948660:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948667:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948673:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948679:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948685:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948691:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948696:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948702:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948708:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948715:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.948720:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789601539.954655:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff91ee003e9800:6688] 1 exiting: rc = 0 00000100:00100000:1.0:1789601539.955039:0:6687:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff91edf8739400:6687] 0 exiting: rc = 1 00000100:00100000:3.0:1789601539.955559:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955570:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955578:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955584:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955592:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955599:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955607:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955629:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955638:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955645:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955653:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955661:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955668:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955674:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955682:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955689:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955695:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955720:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955728:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955750:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955758:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.955767:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957164:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957182:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957679:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957691:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957699:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957706:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957713:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957720:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957727:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957733:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957740:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957754:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957781:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957790:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957797:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957804:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957811:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957819:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957825:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.957832:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958335:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958345:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958351:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958357:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958379:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958387:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958394:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958400:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958407:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958413:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958435:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958442:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958449:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958456:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958473:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958481:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958503:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958511:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958518:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958526:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958536:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789601539.958554:0:13359:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789601539.983635:0:13359:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789601559.891019:0:13975:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789601569.827255:0:14436:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789601569.827261:0:14436:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789601569.827381:0:14436:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91edc5026000 00000020:01000004:2.0:1789601569.827398:0:14436:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789601569.827406:0:14436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789601569.827420:0:14436:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff91edc82ccd40) 00000020:00000080:2.0:1789601569.827435:0:14436:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789601569.856261:0:14436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789601569.871196:0:14436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1789601569.879854:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 579: rc = 0 00100000:10000000:2.0:1789601569.881503:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:2.0:1789601569.883131:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1789601569.883302:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1789601569.885378:0:14436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789601569.890224:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 579: rc = 0 00100000:10000000:2.0:1789601569.890447:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1789601569.896320:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 581: rc = 0 00100000:10000000:2.0:1789601569.897446:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 407: rc = 0 00100000:10000000:2.0:1789601569.897554:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 407: rc = 0 00100000:10000000:2.0:1789601569.898105:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 298: rc = 0 00100000:10000000:2.0:1789601569.898371:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 298: rc = 0 00100000:10000000:2.0:1789601569.898641:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 298: rc = 0 00100000:10000000:2.0:1789601569.904582:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 298: rc = 0 00100000:10000000:3.0:1789601569.912414:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 298: rc = 0 00100000:10000000:3.0:1789601569.913191:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 298: rc = 0 00100000:10000000:3.0:1789601569.915049:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 298: rc = 0 00100000:10000000:3.0:1789601569.915749:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 298: rc = 0 00100000:10000000:3.0:1789601569.917779:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 298: rc = 0 00100000:10000000:3.0:1789601569.918492:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 298: rc = 0 00100000:10000000:3.0:1789601569.920104:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 298: rc = 0 00100000:10000000:3.0:1789601569.920681:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 298: rc = 0 00100000:10000000:3.0:1789601569.922638:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 729: rc = 0 00100000:10000000:3.0:1789601569.925464:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 729: rc = 0 00100000:10000000:3.0:1789601569.925932:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 729: rc = 0 00100000:10000000:3.0:1789601569.926210:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 729: rc = 0 00100000:10000000:3.0:1789601569.926464:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 729: rc = 0 00100000:10000000:3.0:1789601569.926736:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 729: rc = 0 00100000:10000000:3.0:1789601569.928256:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 729: rc = 0 00100000:10000000:3.0:1789601569.934192:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 729: rc = 0 00100000:10000000:2.0:1789601569.944375:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 729: rc = 0 00100000:10000000:2.0:1789601569.945677:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 729: rc = 0 00100000:10000000:2.0:1789601569.949685:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 729: rc = 0 00100000:10000000:2.0:1789601569.953649:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 729: rc = 0 00100000:10000000:2.0:1789601569.959634:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 729: rc = 0 00100000:10000000:2.0:1789601569.963274:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 729: rc = 0 00100000:10000000:2.0:1789601569.969818:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 729: rc = 0 00100000:10000000:3.0:1789601569.972789:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 729: rc = 0 00100000:10000000:3.0:1789601569.973205:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 729: rc = 0 00100000:10000000:3.0:1789601569.973451:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 729: rc = 0 00100000:10000000:3.0:1789601569.973697:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 729: rc = 0 00100000:10000000:3.0:1789601569.973999:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 729: rc = 0 00100000:10000000:3.0:1789601569.974286:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 729: rc = 0 00100000:10000000:3.0:1789601569.974532:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 729: rc = 0 00100000:10000000:3.0:1789601569.974786:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 729: rc = 0 00100000:10000000:3.0:1789601569.975136:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 729: rc = 0 00100000:10000000:3.0:1789601569.975411:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 729: rc = 0 00100000:10000000:3.0:1789601569.975678:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 729: rc = 0 00100000:10000000:3.0:1789601569.981212:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 729: rc = 0 00100000:10000000:3.0:1789601569.981692:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 729: rc = 0 00100000:10000000:3.0:1789601569.982233:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 729: rc = 0 00100000:10000000:3.0:1789601569.982476:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 729: rc = 0 00100000:10000000:3.0:1789601569.982708:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 729: rc = 0 00100000:10000000:3.0:1789601569.983492:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 729: rc = 0 00100000:10000000:3.0:1789601569.983892:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 99: rc = 0 00100000:10000000:1.0:1789601569.997605:0:14436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1789601569.997992:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 408: rc = 0 00100000:10000000:1.0:1789601569.998201:0:14436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1789601569.998264:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 408: rc = 0 00100000:10000000:1.0:1789601569.998472:0:14436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1789601569.998532:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 408: rc = 0 00100000:10000000:1.0:1789601570.004305:0:14436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1789601570.004432:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 89: rc = 0 00100000:10000000:1.0:1789601570.005409:0:14436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1789601570.010218:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 89: rc = 0 00100000:10000000:1.0:1789601570.011446:0:14436:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1789601570.011991:0:14436:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 89: rc = 0 00000020:00000080:1.0:1789601570.016981:0:14436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789601570.016995:0:14436:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789601570.017009:0:14436:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3d6e402158acf0f 00000020:01000004:1.0:1789601570.017018:0:14436:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1789601570.017023:0:14436:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789601570.017031:0:14436:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91edc5026000 from MGS 00000020:01000004:1.0:1789601570.017035:0:14436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789601570.017046:0:14436:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff91edc6010000) 00000020:00000080:1.0:1789601570.017061:0:14436:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789601570.018327:0:14436:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91edc5026000 from MGS, refs=2 00080000:01000000:1.0:1789601570.018337:0:14436:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789601570.018344:0:14436:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3d6e402158acf1d 00000100:00100000:1.0:1789601570.020029:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789601570.021742:0:14436:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789601570.021752:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789601570.029003:0:14436:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789601570.029022:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789601570.040382:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789601570.041230:0:14436:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789601570.041240:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789601570.042480:0:14436:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789601570.042491:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789601570.045912:0:14436:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789601570.045938:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789601570.059648:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601570.059656:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601570.059659:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601570.064293:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601570.064301:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601570.064304:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601570.065384:0:14436:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789601570.067445:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789601570.124997:0:14436:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789601570.125016:0:14436:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789601570.125019:0:14436:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789601570.131964:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789601570.132371:0:14436:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789601570.132492:0:14436:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789601570.140503:0:14436:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789601570.140887:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789601570.141111:0:14436:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789601570.141118:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789601570.147742:0:14436:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789601570.147761:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789601570.164440:0:14436:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789601570.164455:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789601570.166078:0:14436:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789601570.166106:0:14436:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.130@tcp' 00000020:01000004:2.0:1789601570.166109:0:14436:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789601570.166156:0:14436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.130@tcp (typ=mgc) 00000020:00000080:2.0:1789601570.166171:0:14436:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.130@tcp (ffff91edc82c8000) 00000020:00000080:2.0:1789601570.166187:0:14436:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789601570.166885:0:14436:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91edc5020000@MGC192.168.201.130@tcp: add connection 192.168.201.130@tcp at head 00010000:00010000:2.0:1789601570.167138:0:14436:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.130@tcp-0 is initialized 00000040:01000000:2.0:1789601570.167146:0:14436:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789601570.183537:0:14451:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789601570.183645:0:14436:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.130@tcp (uuid ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c) 00000020:00000080:2.0:1789601570.183673:0:14436:0:(genops.c:1384:class_connect()) connect: client ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c, cookie 0xf3d6e402158acf2b 00000100:00080000:2.0:1789601570.183701:0:14436:0:(import.c:545:import_select_connection()) MGC192.168.201.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789601570.183712:0:14436:0:(import.c:666:import_select_connection()) MGC192.168.201.130@tcp: import ffff91edc5020000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1789601570.183752:0:14436:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ecc2c6f100 x1876532880565376/t0(0) o250->MGC192.168.201.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789601570.183805:0:14436:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c->MGS 00000020:01000004:2.0:1789601570.183829:0:14436:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789601570.183858:0:14436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789601570.183877:0:14436:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff91edc82cb380) 00000020:00000080:2.0:1789601570.183903:0:14436:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789601570.184364:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3316:1876532880565376:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789601570.184444:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601570.184556:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880565376 00000100:00100000:0.0:1789601570.184565:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880565376 00000100:00100000:0.0:1789601570.184600:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601570.184608:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3316:x1876532880565376:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789601570.184635:0:14447:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:0.0:1789601570.184657:0:14447:0:(genops.c:1384:class_connect()) connect: client ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c, cookie 0xf3d6e402158acf39 00000100:00080000:0.0:1789601570.184800:0:14447:0:(import.c:65:import_set_state_nolock()) ffff91edf812f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601570.184894:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+5:3316:x1876532880565376:12345-0@lo:250:mount.lustre.0 Request processed in 286us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601570.184903:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601570.184962:0:3316:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789601570.184972:0:3316:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.130@tcp: connect to target with instance 0 00000100:00080000:0.0:1789601570.184979:0:3316:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789601570.184985:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789601570.184989:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91edc5020000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789601570.184992:0:3316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789601570.185000:0:3316:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789601570.185006:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3316:1876532880565376:0@lo:250:mount.lustre.0 00000100:00080000:0.0:1789601570.189541:0:14450:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1789601570.215699:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789601570.227550:0:14436:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789601570.227565:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789601570.230700:0:14436:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789601570.230715:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789601570.231632:0:14436:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789601570.231642:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789601570.232661:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789601570.233063:0:14436:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789601570.233070:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789601570.234068:0:14436:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789601570.234080:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789601570.374044:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789601570.375108:0:14436:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789601570.375129:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789601570.384457:0:14436:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789601570.384472:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789601570.385732:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789601570.386734:0:14436:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789601570.386744:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789601570.406872:0:14436:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789601570.406898:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789601570.415668:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789601570.415907:0:14436:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789601570.415922:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789601570.417056:0:14436:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789601570.417065:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789601570.417896:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789601570.418070:0:14436:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789601570.418075:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789601570.418999:0:14436:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789601570.419007:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789601570.532049:0:14436:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789601570.532268:0:14436:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789601570.532275:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789601570.538071:0:14436:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789601570.538224:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789601570.539508:0:14436:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789601570.539520:0:14436:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789601570.550750:0:14436:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789601570.550798:0:14436:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789601570.550807:0:14436:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789601570.552474:0:14436:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789601570.553397:0:14436:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.130@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789601570.553407:0:14436:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789601570.553409:0:14436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789601570.553411:0:14436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601570.553414:0:14436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601570.553415:0:14436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601570.553417:0:14436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601570.553420:0:14436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789601570.553423:0:14436:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789601570.553425:0:14436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601570.553426:0:14436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789601570.553433:0:14436:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789601570.553436:0:14436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789601570.553437:0:14436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789601570.553438:0:14436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601570.553439:0:14436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601570.553441:0:14436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601570.553442:0:14436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601570.553451:0:14436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789601570.553452:0:14436:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789601570.553453:0:14436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601570.553454:0:14436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789601570.553497:0:14436:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789601570.553599:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880565504:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789601570.553725:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601570.554103:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc79e40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601570.555763:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880565504 00000100:00100000:2.0:1789601570.555780:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880565504 00000100:00100000:2.0:1789601570.556124:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789601570.556139:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+5:14436:x1876532880565504:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789601570.556214:0:14449:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789601570.556218:0:14449:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789601570.556220:0:14449:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789601570.558140:0:14470:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789601570.562662:0:14449:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1789601570.569715:0:14471:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789601570.569725:0:14471:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789601570.569729:0:14471:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789601570.569765:0:14471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1789601570.573223:0:14449:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789601570.573439:0:14449:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789601570.593771:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+5:14436:x1876532880565504:12345-0@lo:253:mount.lustre.0 Request processed in 37619us (40028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601570.593800:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789601570.597186:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880565504:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789601570.597225:0:14436:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789601570.597229:0:14436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789601570.597231:0:14436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789601570.597233:0:14436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601570.597234:0:14436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601570.597235:0:14436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601570.597236:0:14436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601570.597238:0:14436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789601570.597239:0:14436:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789601570.597241:0:14436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601570.597243:0:14436:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789601570.597278:0:14436:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91edc5026000 from lustre-MDT0000 10000000:01000000:0.0:1789601570.598610:0:14436:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789601570.598621:0:14436:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789601570.598628:0:14436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff91edc82c8000 10000000:01000000:0.0:1789601570.598639:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789601570.598656:0:14436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91edc82c8000 from 1 10000000:01000000:0.0:1789601570.598660:0:14436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789601570.598734:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee00925a00/0xf3d6e402158acf40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.598749:0:14436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91ee00925a00/0xf3d6e402158acf40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.598786:0:14436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91ee00925a00/0xf3d6e402158acf40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601570.598821:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880565632:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789601570.600183:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601570.600269:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8d4bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601570.600443:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880565632 00000100:00100000:2.0:1789601570.600460:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880565632 00000100:00100000:2.0:1789601570.600542:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789601570.600553:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+5:14436:x1876532880565632:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789601570.600573:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601570.600616:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edd8d8c200/0xf3d6e402158acf47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158acf40 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.600646:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edd8d8c200/0xf3d6e402158acf47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158acf40 expref: 6 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.600659:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edd8d8c200/0xf3d6e402158acf47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158acf40 expref: 6 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601570.600668:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8c200, rc 0) 00000100:00100000:2.0:1789601570.601464:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+6:14436:x1876532880565632:12345-0@lo:101:mount.lustre.0 Request processed in 909us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601570.601474:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789601570.601611:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880565632:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601570.601634:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91ee00925a00/0xf3d6e402158acf40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acf47 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.601645:0:14436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91ee00925a00/0xf3d6e402158acf40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158acf47 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601570.601723:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880565760:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601570.601770:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601570.601811:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8d4bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789601570.606373:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880565760 00000100:00100000:3.0:1789601570.606396:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880565760 00000100:00100000:3.0:1789601570.606489:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789601570.606502:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+6:14436:x1876532880565760:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601570.607033:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+6:14436:x1876532880565760:12345-0@lo:501:mount.lustre.0 Request processed in 531us (5258us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789601570.607060:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789601570.607120:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880565760:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789601570.607191:0:14436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789601570.607288:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee00925a00/0xf3d6e402158acf40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acf47 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.607301:0:14436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91ee00925a00/0xf3d6e402158acf40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acf47 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601570.607312:0:14436:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91edc5026000 10000000:01000000:0.0:1789601570.607322:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789601570.607343:0:14436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91edc5026000 10000000:01000000:0.0:1789601570.607347:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789601570.607351:0:14436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91edc5026000 from 1 10000000:01000000:0.0:1789601570.607353:0:14436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789601570.607395:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee00924600/0xf3d6e402158acf4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.607404:0:14436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91ee00924600/0xf3d6e402158acf4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.607415:0:14436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91ee00924600/0xf3d6e402158acf4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601570.607437:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880565888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789601570.607505:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601570.607557:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8d4bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789601570.608058:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880565888 00000100:00100000:1.0:1789601570.608068:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880565888 00000100:00100000:1.0:1789601570.608126:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789601570.608136:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+6:14436:x1876532880565888:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789601570.608159:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601570.608175:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc29c5400/0xf3d6e402158acf55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158acf4e expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601570.608201:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c5400/0xf3d6e402158acf55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158acf4e expref: 7 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601570.608214:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc29c5400/0xf3d6e402158acf55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158acf4e expref: 7 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601570.608233:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c5400, rc 0) 00000100:00100000:1.0:1789601570.608293:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+7:14436:x1876532880565888:12345-0@lo:101:mount.lustre.0 Request processed in 158us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601570.608300:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789601570.608690:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880565888:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601570.608707:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91ee00924600/0xf3d6e402158acf4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acf55 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.608717:0:14436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91ee00924600/0xf3d6e402158acf4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158acf55 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601570.608732:0:14436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789601570.609412:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee00924600/0xf3d6e402158acf4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acf55 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.609425:0:14436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91ee00924600/0xf3d6e402158acf4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acf55 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601570.609449:0:14436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789601570.609454:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789601570.609460:0:14436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91edc5026000 10000000:01000000:0.0:1789601570.609462:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789601570.609466:0:14436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789601570.609469:0:14436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789601570.609494:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee00925200/0xf3d6e402158acf5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.609501:0:14436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91ee00925200/0xf3d6e402158acf5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.609510:0:14436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91ee00925200/0xf3d6e402158acf5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601570.609540:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880566016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789601570.609585:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601570.609619:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8d4bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789601570.609665:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880566016 00000100:00100000:3.0:1789601570.609679:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880566016 00000100:00100000:3.0:1789601570.609749:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789601570.609762:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+7:14436:x1876532880566016:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601570.609780:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601570.609805:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edffadd800/0xf3d6e402158acf63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158acf5c expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.609868:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edffadd800/0xf3d6e402158acf63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158acf5c expref: 8 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.609894:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edffadd800/0xf3d6e402158acf63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158acf5c expref: 8 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.609905:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadd800, rc 0) 00000100:00100000:3.0:1789601570.609998:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+8:14436:x1876532880566016:12345-0@lo:101:mount.lustre.0 Request processed in 240us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601570.610006:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789601570.610082:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880566016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601570.610100:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91ee00925200/0xf3d6e402158acf5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acf63 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.610109:0:14436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91ee00925200/0xf3d6e402158acf5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158acf63 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601570.610176:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880566144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601570.610210:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601570.610257:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8d4bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789601570.611348:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880566144 00000100:00100000:3.0:1789601570.611364:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880566144 00000100:00100000:3.0:1789601570.611607:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789601570.611622:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+8:14436:x1876532880566144:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601570.613177:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+9:14436:x1876532880566144:12345-0@lo:501:mount.lustre.0 Request processed in 1552us (2957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601570.613192:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789601570.613246:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880566144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601570.613330:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880566272:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789601570.613410:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601570.613461:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8d4bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789601570.613552:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880566272 00000100:00100000:3.0:1789601570.613574:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880566272 00000100:00100000:3.0:1789601570.613627:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789601570.613637:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+9:14436:x1876532880566272:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789601570.614823:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+9:14436:x1876532880566272:12345-0@lo:503:mount.lustre.0 Request processed in 1179us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601570.614865:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789601570.615005:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880566272:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789601570.615744:0:14472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14472:1876532880566400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601570.615811:0:14472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601570.615930:0:14472:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8d4ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789601570.616119:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880566400 00000100:00100000:3.0:1789601570.616127:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880566400 00000100:00100000:3.0:1789601570.616211:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789601570.616220:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+9:14472:x1876532880566400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601570.616653:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+9:14472:x1876532880566400:12345-0@lo:502:llog_process_th.0 Request processed in 433us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601570.616661:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789601570.616742:0:14472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14472:1876532880566400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789601570.616767:0:14472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601570.616778:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601570.616780:0:14472:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789601570.616785:0:14472:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789601570.616788:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789601570.616804:0:14472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff91edc71ccd40) 00000020:00000080:0.0:1789601570.616819:0:14472:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789601570.616824:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789601570.616951:0:14472:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789601570.616959:0:14472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3d6e402158acf71 00000020:00000080:0.0:1789601570.617212:0:14472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789601570.617218:0:14472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601570.617222:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601570.617236:0:14472:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789601570.617239:0:14472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601570.617244:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601570.617245:0:14472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789601570.617249:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789601570.617266:0:14472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff91edc71c8000) 00000020:00000080:0.0:1789601570.617277:0:14472:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789601570.617282:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789601570.617285:0:14472:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789601570.617319:0:14472:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789601570.617327:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789601570.617374:0:14472:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91edc5026000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789601570.617386:0:14472:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff91edc71cb380) 00000020:00000080:0.0:1789601570.617393:0:14472:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789601570.617449:0:14472:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789601570.617455:0:14472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3d6e402158acf86 00000020:00000080:0.0:1789601570.617877:0:14472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789601570.617885:0:14472:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789601570.617890:0:14472:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf3d6e402158acf8d 00080000:01000000:0.0:1789601570.617896:0:14472:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789601570.617901:0:14472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3d6e402158acf94 00010000:00010000:2.0:1789601570.752448:0:14472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789601570.752926:0:14472:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1789601570.753459:0:14472:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789601570.758636:0:14472:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff91edc71c99c0) 00000020:00000080:0.0:1789601570.758663:0:14472:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789601570.758744:0:14472:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789601570.758751:0:14472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3d6e402158acfa2 00000020:00000080:1.0:1789601570.760621:0:14472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789601570.785551:0:14472:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf3d6e402158acfa9 00000020:00000080:0.0:1789601570.792810:0:14472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789601570.792826:0:14472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601570.792833:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601570.792858:0:14472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789601570.792864:0:14472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789601570.792867:0:14472:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1789601570.793472:0:14472:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789601570.793478:0:14472:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789601570.793480:0:14472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789601570.793485:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601570.793487:0:14472:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789601570.793491:0:14472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789601570.793496:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601570.793498:0:14472:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789601570.793525:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789601570.793572:0:14472:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789601570.793594:0:14472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789601570.793596:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601570.793598:0:14472:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789601570.793600:0:14472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789601570.793603:0:14472:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789601570.793606:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789601570.793607:0:14472:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789601570.793609:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789601570.793615:0:14472:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:0.0:1789601570.793640:0:14472:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789601570.793643:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789601570.793668:0:14472:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff91edfae64d40) 00000020:00000080:0.0:1789601570.793686:0:14472:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789601570.793694:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789601570.793749:0:14472:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789601570.793755:0:14472:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789601570.793761:0:14472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3d6e402158acfb7 00010000:00080000:0.0:1789601570.793792:0:14472:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91edc601c000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:0.0:1789601570.795823:0:14472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1789601570.802507:0:14472:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789601570.803408:0:14472:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789601570.807999:0:14472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789601570.808083:0:14472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1789601570.808806:0:14472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789601570.809704:0:14476:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789601570.809710:0:14476:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789601570.810603:0:14472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789601570.810615:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789601570.810645:0:14472:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789601570.810663:0:14472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3d6e402158acfbe 00000100:00080000:2.0:1789601570.810674:0:14472:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789601570.810687:0:14472:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91edc601c000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1789601570.810723:0:14472:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ecc2c6c380 x1876532880566528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789601570.810752:0:14472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1789601570.810853:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880566528:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789601570.810929:0:3316:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876532880566528 offset 0 length 520: 4 00000020:01000000:2.0:1789601570.811242:0:14472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601570.811247:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601570.811258:0:14472:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789601570.811262:0:14472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789601570.811265:0:14472:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1789601570.811268:0:14472:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789601570.811270:0:14472:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789601570.811271:0:14472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789601570.811274:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601570.811275:0:14472:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789601570.811278:0:14472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789601570.811282:0:14472:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789601570.811286:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601570.811287:0:14472:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789601570.811290:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789601570.811293:0:14472:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.130@tcp to nid 0x20000c0a8c982 (192.168.201.130@tcp) 00000020:01000000:2.0:1789601570.811315:0:14472:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789601570.811318:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789601570.811330:0:14472:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91edc82c99c0) 00000020:00000080:2.0:1789601570.811342:0:14472:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789601570.811347:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789601570.811414:0:14472:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789601570.811420:0:14472:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789601570.811426:0:14472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf3d6e402158acfcc 00010000:00080000:2.0:1789601570.811456:0:14472:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91eddccc1000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:2.0:1789601570.811763:0:14472:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789601570.812217:0:14472:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789601570.812422:0:14472:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789601570.814114:0:14472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789601570.814404:0:14472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789601570.814475:0:14472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789601570.815375:0:14478:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789601570.815381:0:14478:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789601570.822715:0:14472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789601570.822737:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789601570.822782:0:14472:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789601570.822802:0:14472:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3d6e402158acfd3 00000100:00080000:2.0:1789601570.822888:0:14472:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789601570.822902:0:14472:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eddccc1000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1789601570.822952:0:14472:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ecc2c6df80 x1876532880566656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789601570.822977:0:14472:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789601570.823024:0:14472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601570.823419:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601570.823423:0:14472:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789601570.823428:0:14472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601570.823433:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601570.823435:0:14472:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789601570.823438:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789601570.823441:0:14472:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789601570.823443:0:14472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601570.823446:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601570.823447:0:14472:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789601570.823450:0:14472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601570.823452:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601570.823453:0:14472:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789601570.823457:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789601570.823490:0:14472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14472:1876532880566784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601570.824202:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880566656:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1789601570.824404:0:14472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:1.0:1789601570.824484:0:3316:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876532880566656 offset 0 length 520: 4 00000100:00100000:2.0:1789601570.824589:0:14472:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede52b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789601570.827009:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880566784 00000100:00100000:2.0:1789601570.827026:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880566784 00000100:00100000:2.0:1789601570.827311:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789601570.827323:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+9:14472:x1876532880566784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601570.828716:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+9:14472:x1876532880566784:12345-0@lo:502:llog_process_th.0 Request processed in 1390us (4306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601570.828725:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789601570.829066:0:14472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14472:1876532880566784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601570.829102:0:14472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601570.829110:0:14472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601570.829113:0:14472:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789601570.829119:0:14472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789601570.829349:0:14436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1789601570.829370:0:14436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789601570.829392:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee00925200/0xf3d6e402158acf5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acf63 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.829408:0:14436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91ee00925200/0xf3d6e402158acf5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acf63 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601570.829416:0:14436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91edc5026000 from 1 10000000:01000000:0.0:1789601570.829419:0:14436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789601570.829453:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee00924a00/0xf3d6e402158acfda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.829460:0:14436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91ee00924a00/0xf3d6e402158acfda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.829469:0:14436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91ee00924a00/0xf3d6e402158acfda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601570.829489:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880566912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789601570.829538:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601570.829569:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8d4bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601570.829666:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880566912 00000100:00100000:3.0:1789601570.829674:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880566912 00000100:00100000:3.0:1789601570.829716:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789601570.829723:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+9:14436:x1876532880566912:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601570.829736:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601570.829751:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edffadc000/0xf3d6e402158acfe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158acfda expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.829774:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edffadc000/0xf3d6e402158acfe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158acfda expref: 10 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.829785:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edffadc000/0xf3d6e402158acfe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158acfda expref: 10 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.829793:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc000, rc 0) 00000100:00100000:3.0:1789601570.829857:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+10:14436:x1876532880566912:12345-0@lo:101:mount.lustre.0 Request processed in 111us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601570.829864:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789601570.830232:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880566912:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601570.830245:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91ee00924a00/0xf3d6e402158acfda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acfe1 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.830255:0:14436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91ee00924a00/0xf3d6e402158acfda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158acfe1 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601570.830787:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880567040:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789601570.830860:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601570.830898:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8d4bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789601570.830935:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880567040 00000100:00100000:0.0:1789601570.830941:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880567040 00000100:00100000:0.0:1789601570.830967:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789601570.830973:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+10:14436:x1876532880567040:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789601570.830988:0:14447:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789601570.830993:0:14447:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789601570.831068:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+10:14436:x1876532880567040:12345-0@lo:256:mount.lustre.0 Request processed in 94us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601570.831076:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789601570.831107:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880567040:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789601570.831633:0:14436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789601570.831643:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee00924a00/0xf3d6e402158acfda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acfe1 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.831652:0:14436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91ee00924a00/0xf3d6e402158acfda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acfe1 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601570.831660:0:14436:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91edc5026000 from 1 10000000:01000000:0.0:1789601570.831662:0:14436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789601570.831684:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee00925800/0xf3d6e402158acfe8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.831692:0:14436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91ee00925800/0xf3d6e402158acfe8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.831701:0:14436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91ee00925800/0xf3d6e402158acfe8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601570.831714:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880567168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789601570.831745:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601570.831760:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc211e180 going to sleep for 11 seconds 00000100:00100000:0.0:1789601570.831775:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880567168 00000100:00100000:0.0:1789601570.831779:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880567168 00000100:00100000:0.0:1789601570.831797:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789601570.831801:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+10:14436:x1876532880567168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601570.831809:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601570.831822:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ee00925000/0xf3d6e402158acfef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158acfe8 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.831856:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ee00925000/0xf3d6e402158acfef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158acfe8 expref: 11 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.831866:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ee00925000/0xf3d6e402158acfef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158acfe8 expref: 11 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.831873:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00925000, rc 0) 00000100:00100000:0.0:1789601570.831901:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+11:14436:x1876532880567168:12345-0@lo:101:mount.lustre.0 Request processed in 98us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601570.831916:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789601570.831945:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880567168:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601570.831956:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91ee00925800/0xf3d6e402158acfe8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acfef expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.831964:0:14436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91ee00925800/0xf3d6e402158acfe8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158acfef expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601570.832005:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880567296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601570.832035:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601570.832047:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc211e180 going to sleep for 11 seconds 00000100:00100000:0.0:1789601570.832058:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880567296 00000100:00100000:0.0:1789601570.832062:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880567296 00000100:00100000:0.0:1789601570.832078:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789601570.832083:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+11:14436:x1876532880567296:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601570.832435:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+11:14436:x1876532880567296:12345-0@lo:501:mount.lustre.0 Request processed in 351us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601570.832443:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789601570.832467:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880567296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601570.832488:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880567424:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789601570.832519:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601570.832530:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc211e180 going to sleep for 11 seconds 00000100:00100000:0.0:1789601570.832541:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880567424 00000100:00100000:0.0:1789601570.832544:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880567424 00000100:00100000:0.0:1789601570.832558:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789601570.832562:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+11:14436:x1876532880567424:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789601570.832677:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+11:14436:x1876532880567424:12345-0@lo:503:mount.lustre.0 Request processed in 113us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601570.832683:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789601570.832713:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880567424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789601570.835782:0:14480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14480:1876532880567552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601570.835992:0:14480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601570.836259:0:14480:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8b76000 going to sleep for 11 seconds 00000100:00100000:0.0:1789601570.836360:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880567552 00000100:00100000:0.0:1789601570.836368:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880567552 00000100:00100000:0.0:1789601570.836451:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789601570.836461:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+11:14480:x1876532880567552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601570.836746:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+11:14480:x1876532880567552:12345-0@lo:502:llog_process_th.0 Request processed in 286us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601570.836754:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789601570.836880:0:14480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14480:1876532880567552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601570.836921:0:14480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601570.836932:0:14480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601570.836934:0:14480:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789601570.836942:0:14480:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91edc5026000 00000020:00000080:1.0:1789601570.836945:0:14480:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789601570.836952:0:14480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601570.836954:0:14480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601570.836955:0:14480:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789601570.836958:0:14480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601570.836960:0:14480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601570.836961:0:14480:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789601570.836964:0:14480:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91edc5026000 00000020:00000080:1.0:1789601570.836966:0:14480:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789601570.837020:0:14480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601570.837024:0:14480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601570.837026:0:14480:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789601570.837041:0:14480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601570.837044:0:14480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601570.837045:0:14480:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789601570.837049:0:14480:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91edc5026000 00000020:00000080:1.0:1789601570.837052:0:14480:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789601570.837097:0:14480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00662d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14480:1876532880567680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789601570.837430:0:14480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601570.837683:0:14480:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf7e36900 going to sleep for 11 seconds 00000100:00100000:3.0:1789601570.837747:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880567680 00000100:00100000:3.0:1789601570.837753:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880567680 00000100:00100000:3.0:1789601570.837785:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789601570.837792:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+11:14480:x1876532880567680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789601570.838366:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+11:14480:x1876532880567680:12345-0@lo:502:llog_process_th.0 Request processed in 572us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601570.838375:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789601570.843793:0:14480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00662d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14480:1876532880567680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789601570.843867:0:14480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601570.843997:0:14480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601570.844000:0:14480:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789601570.844006:0:14480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789601570.844355:0:14436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789601570.844379:0:14436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789601570.851993:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee00925800/0xf3d6e402158acfe8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acfef expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.852012:0:14436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91ee00925800/0xf3d6e402158acfe8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acfef expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601570.852083:0:14436:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789601570.852087:0:14436:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91edc5026000 10000000:01000000:0.0:1789601570.852090:0:14436:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91edc5026000 10000000:01000000:0.0:1789601570.852094:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789601570.852100:0:14436:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91edc5026000 from 1 10000000:01000000:0.0:1789601570.852103:0:14436:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789601570.852152:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee00924000/0xf3d6e402158acff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.852161:0:14436:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91ee00924000/0xf3d6e402158acff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.852174:0:14436:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91ee00924000/0xf3d6e402158acff6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601570.852199:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880567808:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789601570.852385:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601570.852432:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc211e300 going to sleep for 11 seconds 00000100:00100000:3.0:1789601570.852987:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880567808 00000100:00100000:3.0:1789601570.852997:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880567808 00000100:00100000:3.0:1789601570.853061:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789601570.853071:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+11:14436:x1876532880567808:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601570.853086:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601570.853099:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edffadde00/0xf3d6e402158acffd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158acff6 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.853289:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edffadde00/0xf3d6e402158acffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158acff6 expref: 12 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.853302:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edffadde00/0xf3d6e402158acffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158acff6 expref: 12 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601570.853310:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadde00, rc 0) 00000100:00100000:3.0:1789601570.853366:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:14436:x1876532880567808:12345-0@lo:101:mount.lustre.0 Request processed in 297us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601570.853373:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789601570.856745:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880567808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601570.857134:0:14436:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91ee00924000/0xf3d6e402158acff6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acffd expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.857149:0:14436:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91ee00924000/0xf3d6e402158acff6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158acffd expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601570.858420:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880567936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601570.858492:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601570.858541:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc211e300 going to sleep for 11 seconds 00000100:00100000:2.0:1789601570.861323:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880567936 00000100:00100000:2.0:1789601570.861337:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880567936 00000100:00100000:2.0:1789601570.861404:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789601570.861413:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:14436:x1876532880567936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789601570.861735:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:14436:x1876532880567936:12345-0@lo:501:mount.lustre.0 Request processed in 322us (3242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601570.861744:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789601570.876374:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880567936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601570.876444:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880568064:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789601570.876528:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601570.876578:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc211e300 going to sleep for 11 seconds 00000100:00100000:0.0:1789601570.876611:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880568064 00000100:00100000:0.0:1789601570.876619:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880568064 00000100:00100000:0.0:1789601570.876671:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789601570.876680:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:14436:x1876532880568064:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789601570.882266:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:14436:x1876532880568064:12345-0@lo:503:mount.lustre.0 Request processed in 5577us (5729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601570.882281:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789601570.882373:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880568064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789601570.885286:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14485:1876532880568192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789601570.885371:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601570.885422:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc7af4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601570.887245:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880568192 00000100:00100000:0.0:1789601570.887257:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880568192 00000100:00100000:0.0:1789601570.887307:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789601570.887317:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:14485:x1876532880568192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601570.887605:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:14485:x1876532880568192:12345-0@lo:502:llog_process_th.0 Request processed in 285us (2230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601570.887613:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789601570.894939:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14485:1876532880568192:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789601570.895057:0:14485:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789601570.895083:0:14485:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff91edfae60000) 00000020:00000080:0.0:1789601570.895109:0:14485:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1789601570.895441:0:14485:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91edc5026000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789601570.895446:0:14485:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91edc5026000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789601570.895449:0:14485:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91edc5026000 4 00010000:00080000:0.0:1789601570.895484:0:14485:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91edf87e5800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.130@tcp at head 00010000:00010000:0.0:1789601570.899548:0:14485:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1789601570.910767:0:14485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789601570.910808:0:14485:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789601570.910823:0:14485:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf3d6e402158ad00b 00000100:00080000:0.0:1789601570.911097:0:14485:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789601570.911113:0:14485:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91edf87e5800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1789601570.911223:0:14485:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ecc2ed1c00 x1876532880568320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789601570.911250:0:14485:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789601570.912701:0:14485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14485:1876532880568448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601570.912787:0:14485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601570.912826:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880568448 00000100:00100000:0.0:1789601570.912856:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880568448 00000100:00100000:0.0:1789601570.914296:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789601570.914311:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:14485:x1876532880568448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789601570.914659:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:14485:x1876532880568448:12345-0@lo:502:llog_process_th.0 Request processed in 350us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601570.914666:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789601570.914738:0:14485:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc211e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789601570.914767:0:14485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14485:1876532880568448:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789601570.914806:0:14485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789601570.914927:0:14436:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789601570.914948:0:14436:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789601570.914972:0:14436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee00924000/0xf3d6e402158acff6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acffd expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601570.914987:0:14436:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91ee00924000/0xf3d6e402158acff6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acffd expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789601570.915047:0:14436:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789601570.915049:0:14436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789601570.915051:0:14436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601570.915052:0:14436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601570.915054:0:14436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601570.915055:0:14436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601570.915056:0:14436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789601570.915058:0:14436:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789601570.915060:0:14436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601570.915061:0:14436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789601570.915067:0:14436:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789601570.915070:0:14436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789601570.915071:0:14436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789601570.915072:0:14436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601570.915073:0:14436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601570.915074:0:14436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601570.915075:0:14436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601570.915076:0:14436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789601570.915077:0:14436:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789601570.915082:0:14436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601570.915083:0:14436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789601570.915105:0:14436:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789601570.915487:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876532880568320:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789601570.915617:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601570.915689:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880568320 00000100:00100000:1.0:1789601570.915698:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880568320 00000100:00100000:1.0:1789601570.915730:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789601570.915735:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1876532880568320:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789601570.915785:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1876532880568320:12345-0@lo:38:llog_process_th.0 Request processed in 49us (169us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789601570.915792:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789601570.915824:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789601570.915833:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91edf87e5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789601570.915868:0:3316:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789601570.915872:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876532880568320:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789601570.915981:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880568576:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789601570.916591:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601570.916636:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc211ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601570.917808:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880568576 00000100:00100000:1.0:1789601570.917826:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880568576 00000100:00100000:1.0:1789601570.919445:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789601570.919462:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:14436:x1876532880568576:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789601570.919522:0:14449:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789601570.919547:0:14449:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789601571.018669:0:14449:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789601571.018690:0:14449:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789601571.018822:0:14470:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789601571.018828:0:14470:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789601571.018883:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91edd8d8da00/0xf3d6e402158ad012 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.018914:0:14470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edffadc000/0xf3d6e402158acfe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158acfda expref: 12 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.018923:0:14470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91edd8d8da00/0xf3d6e402158ad012 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.018971:0:14470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edffadc000/0xf3d6e402158acfe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158acfda expref: 12 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.018988:0:14470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91edffadc000/0xf3d6e402158acfe1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158acfda expref: 12 pid: 14448 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601571.019330:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14470:1876532880568704:0@lo:104: 00000100:00100000:2.0:1789601571.019393:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601571.019544:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede51be600 going to sleep for 11 seconds 00000100:00100000:3.0:1789601571.026715:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880568704 00000100:00100000:3.0:1789601571.026729:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880568704 00000100:00100000:3.0:1789601571.026772:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789601571.026781:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+3:14470:x1876532880568704:12345-0@lo:104: 00010000:00010000:3.0:1789601571.026799:0:14437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91ee00924a00/0xf3d6e402158acfda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158acfe1 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.026943:0:14437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789601571.026949:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+3:14470:x1876532880568704:12345-0@lo:104: Request processed in 170us (7556us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601571.026957:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789601571.026980:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601571.026987:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91ee00924a00/0xf3d6e402158acfda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158acfe1 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.026994:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924a00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:3.0:1789601571.026998:0:14443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91ee00924a00/0xf3d6e402158acfda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158acfe1 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.027007:0:14443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91ee00924a00/0xf3d6e402158acfda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158acfe1 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601571.027014:0:14443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91ee00924a00/0xf3d6e402158acfda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158acfe1 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601571.027020:0:14443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789601571.027083:0:14443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91ee00924a00/0xf3d6e402158acfda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158acfe1 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.027090:0:14443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789601571.027111:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91ee00924a00/0xf3d6e402158acfda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158acfe1 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.027129:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91ee00924a00/0xf3d6e402158acfda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158acfe1 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.027154:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601571.027156:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601571.027157:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601571.027183:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3320:1876532880568832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601571.027227:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601571.027315:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880568832 00000100:00100000:3.0:1789601571.027320:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880568832 00010000:00010000:3.0:1789601571.027338:0:14439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edffadc000/0xf3d6e402158acfe1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158acfda expref: 13 pid: 14448 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601571.027360:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789601571.027366:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+13:3320:x1876532880568832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789601571.027376:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601571.027381:0:14439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edffadc000/0xf3d6e402158acfe1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158acfda expref: 13 pid: 14448 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.027391:0:14439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edffadc000/0xf3d6e402158acfe1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158acfda expref: 13 pid: 14448 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.027408:0:14439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91edd8d8da00/0xf3d6e402158ad012 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.027423:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edd8d8da00/0xf3d6e402158ad012 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789601571.027438:0:14439:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008610730s 00010000:00010000:3.0:1789601571.027442:0:14439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edd8d8da00/0xf3d6e402158ad012 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.027449:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edd8d8da00/0xf3d6e402158ad012 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.027456:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91edd8d8da00/0xf3d6e402158ad012 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.027462:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91edd8d8da00/0xf3d6e402158ad012 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.027468:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8da00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601571.027472:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91edd8d8da00/0xf3d6e402158ad012 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.027485:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91edd8d8da00/0xf3d6e402158ad012 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.027493:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91edd8d8da00/0xf3d6e402158ad012 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601571.027502:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601571.027726:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+13:3320:x1876532880568832:12345-0@lo:103:ldlm_bl.0 Request processed in 359us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601571.027734:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789601571.027777:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3320:1876532880568832:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789601571.028090:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edffadc000/0xf3d6e402158acfe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158acfda expref: 12 pid: 14448 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601571.028102:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14470:1876532880568704:0@lo:104: 00010000:00010000:2.0:1789601571.028130:0:14470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91edd8d8da00/0xf3d6e402158ad012 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.028140:0:14470:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91edd8d8da00/0xf3d6e402158ad012 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.028146:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91edd8d8da00/0xf3d6e402158ad012 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601571.028152:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edd8d8da00/0xf3d6e402158ad012 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601571.062365:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+11:14436:x1876532880568576:12345-0@lo:253:mount.lustre.0 Request processed in 142898us (145764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601571.062380:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789601571.066423:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14436:1876532880568576:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789601571.066444:0:14436:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789601571.066447:0:14436:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789601571.066450:0:14436:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789601571.066451:0:14436:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601571.066453:0:14436:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601571.066454:0:14436:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601571.066455:0:14436:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601571.066456:0:14436:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789601571.066458:0:14436:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789601571.066459:0:14436:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601571.066461:0:14436:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789601571.066476:0:14436:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789601571.078953:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789601571.079131:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789601571.079439:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789601571.079596:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789601571.079917:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789601571.080083:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789601571.085473:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789601571.085719:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00010000:00010000:2.0:1789601571.088553:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1789601571.088885:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789601571.089172:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789601571.089455:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789601571.089628:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1789601571.153377:0:14436:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1789601571.155274:0:14436:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789601571.156236:0:14493:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789601571.156363:0:14493:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789601571.158457:0:14493:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789601571.158536:0:14493:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789601571.158541:0:14493:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:2.0:1789601571.164981:0:14492:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789601571.164989:0:14492:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1789601571.165532:0:14436:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789601571.165690:0:14436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789601571.166535:0:14436:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789601571.166545:0:14436:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789601571.166704:0:14436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789601571.168810:0:14436:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789601571.174608:0:14436:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789601571.174674:0:14436:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789601571.175226:0:14436:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:0.0:1789601571.176051:0:14436:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1789601571.186556:0:14436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1789601571.249549:0:14436:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789601571.249590:0:14436:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaf678191b988 00100000:10000000:0.0:1789601571.249599:0:14436:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789601571.250892:0:14436:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789601571.250922:0:14436:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789601571.250942:0:14436:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789601571.250964:0:14436:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1789601571.913922:0:14486:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601571.913932:0:14486:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601571.914588:0:14486:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1789601571.914595:0:14486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:2.0:1789601572.106522:0:14451:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789601572.106530:0:14451:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91edc5026000 from 6 10000000:01000000:2.0:1789601572.106536:0:14451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789601572.106588:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edd8d8d800/0xf3d6e402158ad019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.106611:0:14451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edd8d8d800/0xf3d6e402158ad019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601572.106758:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601572.107592:0:14451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edd8d8d800/0xf3d6e402158ad019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601572.107926:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880568960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789601572.108233:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601572.108292:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc2dbcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789601572.108529:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880568960 00000100:00100000:3.0:1789601572.108537:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880568960 00000100:00100000:3.0:1789601572.108594:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789601572.108604:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+11:14451:x1876532880568960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601572.109167:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601572.109187:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edffadd400/0xf3d6e402158ad020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158ad019 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.109218:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edffadd400/0xf3d6e402158ad020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158ad019 expref: 12 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.109229:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edffadd400/0xf3d6e402158ad020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ad019 expref: 12 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601572.109239:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadd400, rc 0) 00000100:00100000:3.0:1789601572.109299:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:14451:x1876532880568960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 696us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601572.109305:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789601572.109757:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880568960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601572.109774:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edd8d8d800/0xf3d6e402158ad019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad020 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601572.109784:0:14451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edd8d8d800/0xf3d6e402158ad019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ad020 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601572.109878:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880569088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789601572.109931:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601572.110518:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880569088 00000100:00100000:1.0:1789601572.110524:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880569088 00000100:00100000:1.0:1789601572.110561:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789601572.110578:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:14451:x1876532880569088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789601572.110598:0:14449:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789601572.110686:0:14449:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789601572.110690:0:14449:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789601572.111549:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:14451:x1876532880569088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 968us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601572.111559:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789601572.120943:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc2dbcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789601572.121472:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880569088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789601572.121974:0:14451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789601572.121987:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edd8d8d800/0xf3d6e402158ad019 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad020 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601572.122014:0:14451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edd8d8d800/0xf3d6e402158ad019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad020 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789601572.938280:0:14486:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789601572.938294:0:14486:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601572.938999:0:14486:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789601572.939071:0:14486:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789601572.939114:0:14486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:0.0:1789601573.131621:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601574.162530:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601575.182771:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601576.202467:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789601576.403721:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601576.403739:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789601576.403741:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601576.403744:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789601576.403747:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789601576.403750:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789601576.403754:0:36:0:(import.c:65:import_set_state_nolock()) ffff91edf87e5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789601576.403769:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91edf87e5800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1789601576.403791:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ecc2ed2300 x1876532880569344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789601576.403908:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3317:1876532880569216:0@lo:400:kworker.0 00000100:00100000:0.0:1789601576.403985:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601576.404275:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880569216 00000100:00100000:0.0:1789601576.404283:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880569216 00000100:00100000:0.0:1789601576.404326:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789601576.404335:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:3317:x1876532880569216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601576.404404:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:3317:x1876532880569216:12345-0@lo:400:kworker.0 Request processed in 70us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601576.404419:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789601576.404462:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3317:1876532880569216:0@lo:400:kworker.0 00000100:00100000:1.0:1789601576.404894:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876532880569344:0@lo:38:kworker.0 00000100:00100000:1.0:1789601576.404930:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601576.406227:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880569344 00000100:00100000:2.0:1789601576.406239:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880569344 00000100:00100000:2.0:1789601576.406277:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789601576.406284:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3316:x1876532880569344:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789601576.406322:0:14456:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:2.0:1789601576.406363:0:14456:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf3d6e402158ad027 00000004:00100000:2.0:1789601576.406383:0:14456:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789601576.406543:0:14456:0:(import.c:65:import_set_state_nolock()) ffff91ede51ef800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789601576.406637:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3316:x1876532880569344:12345-0@lo:38:kworker.0 Request processed in 352us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601576.406645:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789601576.406682:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91ecc2ed2300 x1876532880569344/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789601586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789601576.406700:0:3316:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789601576.406709:0:3316:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789601576.406715:0:3316:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789601576.406718:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91edf87e5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789601576.406724:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3316:1876532880569344:0@lo:38:kworker.0 00000001:02000400:1.0:1789601576.789764:0:14738:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789601577.232647:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601578.249108:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601579.274377:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601580.298442:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601580.489935:0:3316:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789601570/real 1789601570] req@ffff91ecc2c6df80 x1876532880566656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601580 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601580.489979:0:3316:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91ecc2c6df80 x1876532880566656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601580 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601580.489990:0:3316:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789601570/real 1789601570] req@ffff91ecc2c6c380 x1876532880566528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601580 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601580.490004:0:3316:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91ecc2c6c380 x1876532880566528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601580 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789601580.490023:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91eddccc1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789601580.490043:0:3316:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789601580.490048:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880566656:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789601580.490061:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91edc601c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789601580.490068:0:3316:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789601580.490071:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880566528:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789601580.490458:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789601580.490463:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789601580.490466:0:38:0:(import.c:65:import_set_state_nolock()) ffff91edc601c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789601580.490492:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:1.0:1789601580.490498:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789601580.490507:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91edc601c000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1789601580.490526:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ee00661f80 x1876532880569600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789601580.490538:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789601580.490540:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789601580.490542:0:38:0:(import.c:65:import_set_state_nolock()) ffff91eddccc1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789601580.490545:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:1.0:1789601580.490547:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789601580.490550:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eddccc1000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1789601580.490561:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ee00662300 x1876532880569728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789601580.490682:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601580.490694:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3317:1876532880569472:0@lo:400:kworker.0 00000100:00100000:0.0:1789601580.490769:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601580.490885:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880569856:0@lo:400:kworker.0 00000100:00100000:2.0:1789601580.490921:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601580.490963:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880569600:0@lo:8:kworker.0 00000400:00000100:2.0:1789601580.491006:0:3316:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876532880569600 offset 0 length 520: 4 00000100:00100000:2.0:1789601580.491032:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880569728:0@lo:8:kworker.0 00000400:00000100:2.0:1789601580.491051:0:3316:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876532880569728 offset 0 length 520: 4 00000100:00100000:0.0:1789601580.491333:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880569856 00000100:00100000:0.0:1789601580.491341:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880569856 00000100:00100000:0.0:1789601580.491386:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601580.491395:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880569856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601580.491449:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880569856:12345-0@lo:400:kworker.0 Request processed in 54us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601580.491455:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789601580.491514:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91ee00661500 x1876532880569856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601580.491526:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880569856:0@lo:400:kworker.0 00000100:00100000:1.0:1789601580.491699:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880569472 00000100:00100000:1.0:1789601580.491704:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880569472 00000100:00100000:1.0:1789601580.491730:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789601580.491749:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:3317:x1876532880569472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601580.491797:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:3317:x1876532880569472:12345-0@lo:400:kworker.0 Request processed in 60us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601580.491803:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789601580.491881:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3317:1876532880569472:0@lo:400:kworker.0 00000020:00000080:0.0:1789601581.295917:0:14888:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff77db1960 20000000:00000080:0.0:1789601581.295936:0:14888:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91edc4763400 uarg=0000000000000000 20000000:01000000:0.0:1789601581.296048:0:14888:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789601581.296057:0:14888:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789601581.296062:0:14888:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789601581.299573:0:14889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1789601581.299801:0:14888:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789601581.307655:0:14888:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789601581.307778:0:14888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91ee00924200/0xf3d6e402158ad02e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601581.307800:0:14888:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ee00925000/0xf3d6e402158acfef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158acfe8 expref: 11 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601581.307824:0:14888:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91ee00924200/0xf3d6e402158ad02e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601581.308464:0:14888:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ee00925000/0xf3d6e402158acfef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158acfe8 expref: 11 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601581.308477:0:14888:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91ee00925000/0xf3d6e402158acfef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158acfe8 expref: 11 pid: 14447 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601581.308491:0:14888:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14888:1876532880569984:0@lo:104: 00000100:00100000:0.0:1789601581.308550:0:14888:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601581.308653:0:14888:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ee00a5d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789601581.308710:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880569984 00000100:00100000:1.0:1789601581.308718:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880569984 00000100:00100000:1.0:1789601581.308773:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789601581.308783:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2ed1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+3:14888:x1876532880569984:12345-0@lo:104: 00010000:00010000:1.0:1789601581.308796:0:14438:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91ee00925800/0xf3d6e402158acfe8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158acfef expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601581.309203:0:14438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789601581.309211:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2ed1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+3:14888:x1876532880569984:12345-0@lo:104: Request processed in 429us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601581.309219:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789601581.309348:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601581.309356:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91ee00925800/0xf3d6e402158acfe8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158acfef expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601581.309363:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925800 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:2.0:1789601581.309368:0:14442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91ee00925800/0xf3d6e402158acfe8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158acfef expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601581.309379:0:14442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91ee00925800/0xf3d6e402158acfe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158acfef expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601581.309387:0:14442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91ee00925800/0xf3d6e402158acfe8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158acfef expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601581.309393:0:14442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789601581.309434:0:14442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91ee00925800/0xf3d6e402158acfe8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158acfef expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601581.309441:0:14442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601581.309468:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91ee00925800/0xf3d6e402158acfe8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158acfef expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601581.309475:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91ee00925800/0xf3d6e402158acfe8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158acfef expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601581.309505:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601581.309507:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601581.309509:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601581.309517:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789601581.309528:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3319:1876532880570112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601581.309562:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601581.309650:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880570112 00000100:00100000:3.0:1789601581.309655:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880570112 00010000:00010000:3.0:1789601581.309679:0:14439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ee00925000/0xf3d6e402158acfef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158acfe8 expref: 12 pid: 14447 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601581.309731:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789601581.309738:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:3319:x1876532880570112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789601581.309750:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601581.309755:0:14439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ee00925000/0xf3d6e402158acfef lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158acfe8 expref: 12 pid: 14447 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601581.309764:0:14439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ee00925000/0xf3d6e402158acfef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158acfe8 expref: 12 pid: 14447 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601581.309781:0:14439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91ee00924200/0xf3d6e402158ad02e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601581.309790:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ee00924200/0xf3d6e402158ad02e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601581.309804:0:14439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ee00924200/0xf3d6e402158ad02e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601581.309811:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91ee00924200/0xf3d6e402158ad02e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601581.309817:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91ee00924200/0xf3d6e402158ad02e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601581.309823:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91ee00924200/0xf3d6e402158ad02e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601581.309828:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924200 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601581.309831:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91ee00924200/0xf3d6e402158ad02e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601581.310035:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91ee00924200/0xf3d6e402158ad02e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601581.310044:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91ee00924200/0xf3d6e402158ad02e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601581.310054:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601581.310448:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:3319:x1876532880570112:12345-0@lo:103:ldlm_bl.0 Request processed in 710us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601581.310456:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789601581.313281:0:14888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ee00925000/0xf3d6e402158acfef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158acfe8 expref: 11 pid: 14447 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601581.313306:0:14888:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14888:1876532880569984:0@lo:104: 00010000:00010000:0.0:1789601581.313336:0:14888:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91ee00924200/0xf3d6e402158ad02e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601581.313348:0:14888:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91ee00924200/0xf3d6e402158ad02e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601581.313355:0:14888:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91ee00924200/0xf3d6e402158ad02e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601581.313361:0:14888:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ee00924200/0xf3d6e402158ad02e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601581.317136:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3319:1876532880570112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789601581.321978:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789601582.159046:0:14486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1789601582.345082:0:14451:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789601582.345096:0:14451:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91edc5026000 from 10 10000000:01000000:3.0:1789601582.345105:0:14451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789601582.345182:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadc600/0xf3d6e402158ad035 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601582.345198:0:14451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edffadc600/0xf3d6e402158ad035 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601582.345213:0:14451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edffadc600/0xf3d6e402158ad035 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601582.345250:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880570240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789601582.345354:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601582.345429:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc12ed600 going to sleep for 11 seconds 00000100:00100000:0.0:1789601582.345506:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880570240 00000100:00100000:0.0:1789601582.345516:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880570240 00000100:00100000:0.0:1789601582.345584:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789601582.345597:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+11:14451:x1876532880570240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789601582.345613:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601582.345630:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ee00925000/0xf3d6e402158ad03c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158ad035 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601582.345659:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ee00925000/0xf3d6e402158ad03c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158ad035 expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601582.345671:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ee00925000/0xf3d6e402158ad03c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ad035 expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601582.345681:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00925000, rc 0) 00000100:00100000:0.0:1789601582.345758:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:14451:x1876532880570240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601582.345765:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789601582.345933:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880570240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601582.345952:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edffadc600/0xf3d6e402158ad035 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad03c expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601582.345963:0:14451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edffadc600/0xf3d6e402158ad035 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ad03c expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601582.346032:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880570368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601582.346065:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601582.346100:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc3911240 going to sleep for 11 seconds 00000100:00100000:2.0:1789601582.346115:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880570368 00000100:00100000:2.0:1789601582.346119:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880570368 00000100:00100000:2.0:1789601582.346146:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789601582.346153:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:14451:x1876532880570368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601582.346506:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:14451:x1876532880570368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 351us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601582.346513:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789601582.346555:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880570368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601582.346605:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880570496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601582.346652:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601582.346667:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc3911240 going to sleep for 11 seconds 00000100:00100000:2.0:1789601582.346682:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880570496 00000100:00100000:2.0:1789601582.346686:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880570496 00000100:00100000:2.0:1789601582.346718:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789601582.346725:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:14451:x1876532880570496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601582.346951:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:14451:x1876532880570496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 225us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601582.346959:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789601582.347002:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880570496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789601582.347794:0:14909:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789601582.347899:0:14451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789601582.347923:0:14451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789601582.347935:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadc600/0xf3d6e402158ad035 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad03c expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601582.347948:0:14451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edffadc600/0xf3d6e402158ad035 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad03c expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601582.350174:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601583.385354:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601584.400765:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601585.418626:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789601585.609985:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789601585.609994:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789601585.609997:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789601585.610000:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789601585.610047:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880570752:0@lo:400:kworker.0 00000100:00100000:1.0:1789601585.610136:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601585.610210:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789601585.610217:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3318:1876532880570624:0@lo:400:kworker.0 00000100:00100000:1.0:1789601585.610250:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601585.610292:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880570752 00000100:00100000:1.0:1789601585.610301:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880570752 00000100:00100000:1.0:1789601585.610375:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789601585.610385:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880570752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601585.610447:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880570752:12345-0@lo:400:kworker.0 Request processed in 63us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601585.610455:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789601585.610481:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880570624 00000100:00100000:1.0:1789601585.610485:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880570624 00000100:00100000:1.0:1789601585.610514:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789601585.610520:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:3318:x1876532880570624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601585.610572:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:3318:x1876532880570624:12345-0@lo:400:kworker.0 Request processed in 52us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601585.610581:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789601585.610633:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3318:1876532880570624:0@lo:400:kworker.0 00010000:00080000:1.0:1789601585.610659:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91ee00660e00 x1876532880570752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601585.610671:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880570752:0@lo:400:kworker.0 00010000:00010000:2.0:1789601586.441038:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601587.465136:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789601587.489536:0:15138:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789601587.489541:0:15138:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789601587.490205:0:15138:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91ee00b08800 00000020:01000004:2.0:1789601587.490228:0:15138:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789601587.490244:0:15138:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789601587.490262:0:15138:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff91edd17499c0) 00000020:00000080:2.0:1789601587.490293:0:15138:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789601587.518165:0:15138:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789601587.519561:0:15138:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789601587.520386:0:15138:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789601587.520599:0:15138:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789601587.520879:0:15138:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789601587.521235:0:15138:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 528: rc = 0 00100000:10000000:0.0:1789601587.521385:0:15138:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 528: rc = 0 00100000:10000000:0.0:1789601587.521486:0:15138:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 528: rc = 0 00100000:10000000:0.0:1789601587.522072:0:15138:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 308: rc = 0 00100000:10000000:0.0:1789601587.528685:0:15138:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 308: rc = 0 00100000:10000000:0.0:1789601587.529165:0:15138:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 308: rc = 0 00100000:10000000:0.0:1789601587.529675:0:15138:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 308: rc = 0 00100000:10000000:0.0:1789601587.529968:0:15138:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 308: rc = 0 00100000:10000000:0.0:1789601587.532782:0:15138:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 308: rc = 0 00000020:00000080:0.0:1789601587.535098:0:15138:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789601587.535110:0:15138:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789601587.535122:0:15138:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf3d6e402158ad04a 00000020:01000004:0.0:1789601587.535130:0:15138:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1789601587.535153:0:15138:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.130@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789601587.535156:0:15138:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789601587.535163:0:15138:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789601587.535167:0:15138:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789601587.535178:0:15138:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff91edfae619c0) 00000020:00000080:0.0:1789601587.535187:0:15138:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1789601587.541857:0:15138:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789601587.544966:0:15138:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789601587.544983:0:15138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789601587.545940:0:15138:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789601587.545952:0:15138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789601587.556492:0:15138:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789601587.556514:0:15138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789601587.569199:0:15138:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789601587.576329:0:15138:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789601587.576343:0:15138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789601587.577982:0:15138:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789601587.578003:0:15138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789601587.654946:0:15138:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789601587.656390:0:15138:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789601587.656398:0:15138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789601587.658802:0:15138:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789601587.658817:0:15138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789601587.660526:0:15138:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789601587.660538:0:15138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789601587.664310:0:15138:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789601587.664506:0:15138:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789601587.664513:0:15138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789601587.665628:0:15138:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789601587.665644:0:15138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789601587.724207:0:15138:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789601587.724416:0:15138:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789601587.724423:0:15138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789601587.726239:0:15138:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789601587.726255:0:15138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789601587.726739:0:15138:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789601587.726767:0:15138:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1789601587.726774:0:15138:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789601587.749466:0:15138:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789601587.749511:0:15138:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.130@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789601587.749515:0:15138:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789601587.749517:0:15138:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789601587.749518:0:15138:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601587.749519:0:15138:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789601587.749520:0:15138:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601587.749520:0:15138:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601587.749521:0:15138:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789601587.749522:0:15138:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601587.749523:0:15138:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789601587.749526:0:15138:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789601587.749528:0:15138:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789601587.749528:0:15138:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789601587.749529:0:15138:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601587.749530:0:15138:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789601587.749530:0:15138:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601587.749531:0:15138:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601587.749532:0:15138:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789601587.749533:0:15138:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601587.749533:0:15138:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789601587.749558:0:15138:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789601587.749585:0:15138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00660e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880570880:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789601587.749670:0:15138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601587.751426:0:15138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8f1dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601587.751507:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880570880 00000100:00100000:3.0:1789601587.751516:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880570880 00000100:00100000:3.0:1789601587.751564:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789601587.751573:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:15138:x1876532880570880:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789601587.751615:0:14448:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789601587.751618:0:14448:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789601587.751622:0:14448:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789601587.803440:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:15138:x1876532880570880:12345-0@lo:253:mount.lustre.0 Request processed in 51860us (53759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601587.803457:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789601587.803601:0:15138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00660e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880570880:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789601587.803626:0:15138:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789601587.803629:0:15138:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789601587.803631:0:15138:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789601587.803633:0:15138:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789601587.803634:0:15138:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789601587.803635:0:15138:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789601587.803637:0:15138:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789601587.803638:0:15138:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789601587.803639:0:15138:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789601587.803641:0:15138:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789601587.803664:0:15138:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91ee00b08800 from lustre-OST0000 10000000:01000000:2.0:1789601587.803700:0:15138:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789601587.803702:0:15138:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789601587.803710:0:15138:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91edc82c8000 local copy 00010000:00010000:2.0:1789601587.803719:0:15138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee00925a00/0xf3d6e402158acf40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acf47 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601587.804132:0:15138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880571008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789601587.804168:0:15138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601587.804199:0:15138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601587.804265:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880571008 00000100:00100000:1.0:1789601587.804529:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880571008 00000100:00100000:1.0:1789601587.804575:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789601587.804583:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:15138:x1876532880571008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789601587.805262:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:15138:x1876532880571008:12345-0@lo:501:mount.lustre.0 Request processed in 677us (1090us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789601587.805279:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789601587.808654:0:15138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880571008:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789601587.808821:0:15138:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789601587.818170:0:15138:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789601587.818190:0:15138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee00925a00/0xf3d6e402158acf40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acf47 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601587.818204:0:15138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91ee00925a00/0xf3d6e402158acf40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acf47 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601587.818244:0:15138:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91ee00b08800 10000000:01000000:2.0:1789601587.818249:0:15138:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789601587.818255:0:15138:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff91edc82c8000 10000000:01000000:2.0:1789601587.818257:0:15138:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789601587.818261:0:15138:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff91edc82c8000 from 1 10000000:01000000:2.0:1789601587.818264:0:15138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789601587.818304:0:15138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edd8d8c600/0xf3d6e402158ad058 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601587.818312:0:15138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edd8d8c600/0xf3d6e402158ad058 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601587.818324:0:15138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edd8d8c600/0xf3d6e402158ad058 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601587.818349:0:15138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880571136:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789601587.818421:0:15138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601587.818542:0:15138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64300 going to sleep for 11 seconds 00000100:00100000:1.0:1789601587.822064:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880571136 00000100:00100000:1.0:1789601587.822086:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880571136 00000100:00100000:1.0:1789601587.822229:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789601587.822241:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+12:15138:x1876532880571136:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789601587.822260:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601587.822285:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc29c4400/0xf3d6e402158ad05f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158ad058 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601587.822316:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c4400/0xf3d6e402158ad05f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158ad058 expref: 13 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601587.822329:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc29c4400/0xf3d6e402158ad05f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ad058 expref: 13 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601587.822339:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c4400, rc 0) 00000100:00100000:1.0:1789601587.822454:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+13:15138:x1876532880571136:12345-0@lo:101:mount.lustre.0 Request processed in 216us (4032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601587.822462:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789601587.822572:0:15138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880571136:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601587.822591:0:15138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edd8d8c600/0xf3d6e402158ad058 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad05f expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.822600:0:15138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edd8d8c600/0xf3d6e402158ad058 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ad05f expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601587.822656:0:15138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789601587.822678:0:15138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edd8d8c600/0xf3d6e402158ad058 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad05f expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.822686:0:15138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edd8d8c600/0xf3d6e402158ad058 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad05f expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601587.822703:0:15138:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789601587.822709:0:15138:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789601587.822715:0:15138:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789601587.822718:0:15138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789601587.822746:0:15138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadc000/0xf3d6e402158ad066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.822763:0:15138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edffadc000/0xf3d6e402158ad066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.822771:0:15138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edffadc000/0xf3d6e402158ad066 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601587.822792:0:15138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880571264:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789601587.822831:0:15138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601587.824765:0:15138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede0714900 going to sleep for 11 seconds 00000100:00100000:2.0:1789601587.826205:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880571264 00000100:00100000:2.0:1789601587.826219:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880571264 00000100:00100000:2.0:1789601587.826594:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789601587.826617:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+13:15138:x1876532880571264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789601587.826636:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601587.826656:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edd8d8d400/0xf3d6e402158ad06d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158ad066 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601587.826686:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edd8d8d400/0xf3d6e402158ad06d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158ad066 expref: 14 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601587.826819:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edd8d8d400/0xf3d6e402158ad06d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ad066 expref: 14 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601587.826830:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8d400, rc 0) 00000100:00100000:2.0:1789601587.826935:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+14:15138:x1876532880571264:12345-0@lo:101:mount.lustre.0 Request processed in 331us (4102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601587.826942:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789601587.827482:0:15138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880571264:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601587.827503:0:15138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edffadc000/0xf3d6e402158ad066 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad06d expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.827514:0:15138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edffadc000/0xf3d6e402158ad066 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ad06d expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789601587.829299:0:15138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789601587.830399:0:15138:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789601587.830688:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789601587.831123:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789601587.831179:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789601587.831234:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789601587.831272:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789601587.831307:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789601587.831376:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789601587.831385:0:15138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789601587.831476:0:15138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880571392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789601587.831546:0:15138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601587.831597:0:15138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edffe64600 going to sleep for 11 seconds 00000100:00100000:1.0:1789601587.831861:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880571392 00000100:00100000:1.0:1789601587.831870:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880571392 00000100:00100000:1.0:1789601587.831918:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789601587.831928:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+14:15138:x1876532880571392:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789601587.832304:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+14:15138:x1876532880571392:12345-0@lo:501:mount.lustre.0 Request processed in 376us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601587.832312:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789601587.832490:0:15138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880571392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601587.832533:0:15138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880571520:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789601587.832577:0:15138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601587.832616:0:15138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede0714900 going to sleep for 11 seconds 00000100:00100000:2.0:1789601587.833135:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880571520 00000100:00100000:2.0:1789601587.833141:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880571520 00000100:00100000:2.0:1789601587.833172:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789601587.833178:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+14:15138:x1876532880571520:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789601587.833520:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+14:15138:x1876532880571520:12345-0@lo:503:mount.lustre.0 Request processed in 340us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601587.833527:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789601587.833684:0:15138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880571520:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789601587.834232:0:15138:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789601587.834303:0:15138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880571648:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601587.834350:0:15138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601587.834380:0:15138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede0714900 going to sleep for 11 seconds 00000100:00100000:2.0:1789601587.834637:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880571648 00000100:00100000:2.0:1789601587.834643:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880571648 00000100:00100000:2.0:1789601587.834767:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789601587.834776:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+14:15138:x1876532880571648:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789601587.835164:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+14:15138:x1876532880571648:12345-0@lo:502:mount.lustre.0 Request processed in 389us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601587.835173:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789601587.835290:0:15138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880571648:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789601587.835539:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789601587.835589:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789601587.835636:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789601587.835710:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789601587.835743:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789601587.835767:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789601587.835815:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789601587.835873:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789601587.835909:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789601587.835957:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789601587.836122:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789601587.836172:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789601587.836209:0:15138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880571776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601587.836258:0:15138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601587.836530:0:15138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede0714900 going to sleep for 11 seconds 00000100:00100000:0.0:1789601587.836821:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880571776 00000100:00100000:0.0:1789601587.836830:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880571776 00000100:00100000:0.0:1789601587.836907:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789601587.836916:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+14:15138:x1876532880571776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789601587.837147:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+14:15138:x1876532880571776:12345-0@lo:502:mount.lustre.0 Request processed in 232us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601587.837154:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789601587.837535:0:15138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880571776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789601587.837649:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789601587.837663:0:15138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789601587.839266:0:15152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789601587.839356:0:15152:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789601587.839364:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601587.839366:0:15152:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789601587.839372:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789601587.839386:0:15152:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff91edc60519c0) 00000020:00000080:3.0:1789601587.839410:0:15152:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789601587.839415:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789601587.839497:0:15152:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91ee00b08800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789601587.839504:0:15152:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789601587.839511:0:15152:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf3d6e402158ad07b 00010000:00010000:2.0:1789601587.844531:0:15152:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1789601587.845150:0:15152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1789601587.847474:0:15152:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1789601587.849341:0:15152:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789601587.849352:0:15152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601587.849358:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601587.849360:0:15152:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789601587.849363:0:15152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789601587.849365:0:15152:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1789601587.849367:0:15152:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789601587.849368:0:15152:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789601587.849370:0:15152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789601587.849372:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601587.849373:0:15152:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789601587.849375:0:15152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601587.849378:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601587.849379:0:15152:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789601587.849382:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789601587.849383:0:15152:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789601587.849385:0:15152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601587.849387:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601587.849389:0:15152:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789601587.849391:0:15152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601587.849393:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601587.849394:0:15152:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789601587.849403:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789601587.849459:0:15152:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601587.849461:0:15152:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601587.849463:0:15152:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789601587.849466:0:15152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1789601587.849641:0:15138:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789601587.849671:0:15138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789601587.849703:0:15138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadc000/0xf3d6e402158ad066 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad06d expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601587.849716:0:15138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edffadc000/0xf3d6e402158ad066 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad06d expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601587.849725:0:15138:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ee00b08800 from 1 10000000:01000000:0.0:1789601587.849727:0:15138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789601587.849764:0:15138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee00924c00/0xf3d6e402158ad082 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601587.849771:0:15138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91ee00924c00/0xf3d6e402158ad082 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601587.849782:0:15138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91ee00924c00/0xf3d6e402158ad082 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601587.849813:0:15138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880571904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789601587.849906:0:15138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601587.849955:0:15138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf9d66240 going to sleep for 11 seconds 00000100:00100000:3.0:1789601587.850154:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880571904 00000100:00100000:3.0:1789601587.850162:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880571904 00000100:00100000:3.0:1789601587.850217:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789601587.850226:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+14:15138:x1876532880571904:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601587.850240:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601587.850255:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edffadc400/0xf3d6e402158ad089 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158ad082 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.850279:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edffadc400/0xf3d6e402158ad089 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158ad082 expref: 15 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.850290:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edffadc400/0xf3d6e402158ad089 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ad082 expref: 15 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.850299:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadc400, rc 0) 00000100:00100000:3.0:1789601587.850336:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+15:15138:x1876532880571904:12345-0@lo:101:mount.lustre.0 Request processed in 112us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601587.850342:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789601587.850520:0:15138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880571904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601587.850536:0:15138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91ee00924c00/0xf3d6e402158ad082 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad089 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601587.850545:0:15138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91ee00924c00/0xf3d6e402158ad082 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ad089 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789601587.851309:0:15138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789601587.851681:0:15138:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789601587.854225:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789601587.854285:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789601587.854351:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789601587.854360:0:15138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789601587.854475:0:15138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880572032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601587.854540:0:15138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601587.854589:0:15138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf9d66240 going to sleep for 11 seconds 00000100:00100000:1.0:1789601587.857132:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880572032 00000100:00100000:1.0:1789601587.857149:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880572032 00000100:00100000:1.0:1789601587.857213:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789601587.857224:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+15:15138:x1876532880572032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789601587.857547:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+15:15138:x1876532880572032:12345-0@lo:501:mount.lustre.0 Request processed in 326us (3006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601587.857555:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789601587.858188:0:15138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880572032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601587.858244:0:15138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880572160:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789601587.858298:0:15138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601587.858331:0:15138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf9d66240 going to sleep for 11 seconds 00000100:00100000:1.0:1789601587.860197:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880572160 00000100:00100000:1.0:1789601587.860212:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880572160 00000100:00100000:1.0:1789601587.860299:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789601587.860311:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+15:15138:x1876532880572160:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789601587.860548:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+15:15138:x1876532880572160:12345-0@lo:503:mount.lustre.0 Request processed in 239us (2249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601587.860556:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789601587.862256:0:15138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880572160:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789601587.863335:0:15138:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789601587.863434:0:15138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880572288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789601587.863511:0:15138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601587.863620:0:15138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf9d66240 going to sleep for 11 seconds 00000100:00100000:1.0:1789601587.863712:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880572288 00000100:00100000:1.0:1789601587.863720:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880572288 00000100:00100000:1.0:1789601587.863773:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789601587.863793:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+15:15138:x1876532880572288:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789601587.864289:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+15:15138:x1876532880572288:12345-0@lo:502:mount.lustre.0 Request processed in 497us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601587.864297:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789601587.864387:0:15138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880572288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789601587.864674:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789601587.864802:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789601587.864935:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789601587.865050:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789601587.865095:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789601587.865145:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789601587.865183:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789601587.865216:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1789601587.865253:0:15138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880572416:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789601587.865304:0:15138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601587.865331:0:15138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf9d66240 going to sleep for 11 seconds 00000100:00100000:1.0:1789601587.865412:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880572416 00000100:00100000:1.0:1789601587.865418:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880572416 00000100:00100000:1.0:1789601587.865459:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789601587.865466:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+15:15138:x1876532880572416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789601587.865794:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+15:15138:x1876532880572416:12345-0@lo:502:mount.lustre.0 Request processed in 327us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601587.865801:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789601587.866200:0:15138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880572416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789601587.866309:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789601587.866320:0:15138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1789601587.867441:0:15156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601587.867453:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601587.867456:0:15156:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789601587.867462:0:15156:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91ee00b08800 00000020:00000080:3.0:1789601587.867465:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789601587.867472:0:15156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601587.867475:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601587.867477:0:15156:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789601587.867480:0:15156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601587.867489:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601587.867491:0:15156:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789601587.867494:0:15156:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91ee00b08800 00000020:00000080:3.0:1789601587.867497:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789601587.867560:0:15156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601587.867564:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601587.867566:0:15156:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789601587.867568:0:15156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789601587.867571:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601587.867572:0:15156:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789601587.867576:0:15156:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91ee00b08800 00000020:00000080:3.0:1789601587.867578:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789601587.867627:0:15156:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789601587.867632:0:15156:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789601587.867633:0:15156:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789601587.867636:0:15156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789601587.871126:0:15138:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789601587.871177:0:15138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789601587.871209:0:15138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee00924c00/0xf3d6e402158ad082 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad089 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601587.871223:0:15138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91ee00924c00/0xf3d6e402158ad082 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad089 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601587.871282:0:15138:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789601587.871285:0:15138:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91ee00b08800 10000000:01000000:1.0:1789601587.871288:0:15138:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91ee00b08800 10000000:01000000:1.0:1789601587.871292:0:15138:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789601587.871299:0:15138:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91ee00b08800 from 1 10000000:01000000:1.0:1789601587.871301:0:15138:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789601587.871342:0:15138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5e00/0xf3d6e402158ad090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601587.871352:0:15138:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc29c5e00/0xf3d6e402158ad090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601587.871372:0:15138:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc29c5e00/0xf3d6e402158ad090 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601587.871399:0:15138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00660a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880572544:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789601587.871468:0:15138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601587.871509:0:15138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc23d1300 going to sleep for 11 seconds 00000100:00100000:0.0:1789601587.871651:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880572544 00000100:00100000:0.0:1789601587.871662:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880572544 00000100:00100000:0.0:1789601587.871831:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789601587.871861:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+15:15138:x1876532880572544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601587.871875:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601587.871888:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ee00924e00/0xf3d6e402158ad097 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158ad090 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601587.871912:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ee00924e00/0xf3d6e402158ad097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158ad090 expref: 16 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601587.871922:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ee00924e00/0xf3d6e402158ad097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ad090 expref: 16 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601587.871944:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924e00, rc 0) 00000100:00100000:0.0:1789601587.872071:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:15138:x1876532880572544:12345-0@lo:101:mount.lustre.0 Request processed in 213us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601587.872079:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789601587.872172:0:15138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00660a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880572544:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601587.872189:0:15138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc29c5e00/0xf3d6e402158ad090 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad097 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.872199:0:15138:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc29c5e00/0xf3d6e402158ad090 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ad097 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789601587.872886:0:15138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789601587.873348:0:15138:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789601587.873625:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789601587.873670:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789601587.873869:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789601587.873924:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789601587.874086:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789601587.874145:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789601587.874181:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789601587.874241:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789601587.874293:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789601587.874329:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789601587.874364:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789601587.874415:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789601587.874455:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789601587.874490:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789601587.874540:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789601587.874577:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789601587.874624:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789601587.874677:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789601587.878629:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789601587.878923:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789601587.879139:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789601587.879182:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789601587.879217:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789601587.879298:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789601587.879339:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789601587.879377:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789601587.879429:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789601587.879470:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789601587.879568:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789601587.879577:0:15138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1789601587.881232:0:15138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880572672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601587.881306:0:15138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601587.881356:0:15138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede0714a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789601587.881866:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880572672 00000100:00100000:2.0:1789601587.881876:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880572672 00000100:00100000:2.0:1789601587.881930:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789601587.881941:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:15138:x1876532880572672:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789601587.885230:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:15138:x1876532880572672:12345-0@lo:501:mount.lustre.0 Request processed in 3281us (3913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601587.885245:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789601587.885466:0:15138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880572672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601587.885522:0:15138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880572800:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789601587.892793:0:15138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601587.892867:0:15138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede0714a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789601587.893823:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880572800 00000100:00100000:0.0:1789601587.893869:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880572800 00000100:00100000:0.0:1789601587.893930:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789601587.893939:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:15138:x1876532880572800:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789601587.894288:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:15138:x1876532880572800:12345-0@lo:503:mount.lustre.0 Request processed in 348us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601587.894297:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789601587.894940:0:15138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880572800:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789601587.895676:0:15138:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789601587.901105:0:15138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880572928:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789601587.901187:0:15138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601587.901233:0:15138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf9d66180 going to sleep for 11 seconds 00000100:00100000:2.0:1789601587.903789:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880572928 00000100:00100000:2.0:1789601587.903804:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880572928 00000100:00100000:2.0:1789601587.905120:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789601587.905140:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:15138:x1876532880572928:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789601587.905443:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:15138:x1876532880572928:12345-0@lo:502:mount.lustre.0 Request processed in 310us (4255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601587.905452:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789601587.905588:0:15138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880572928:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789601587.905955:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789601587.906403:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789601587.906441:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789601587.906489:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789601587.906522:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789601587.906564:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789601587.906601:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789601587.906647:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789601587.906771:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789601587.906812:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789601587.906879:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789601587.906934:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789601587.906986:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789601587.907104:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789601587.907157:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789601587.907197:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789601587.907233:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789601587.907286:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789601587.907318:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789601587.907371:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789601587.907413:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789601587.907443:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789601587.907487:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789601587.907536:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789601587.907571:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789601587.907622:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789601587.907675:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789601587.908894:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789601587.908948:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789601587.909463:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789601587.909506:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789601587.909539:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789601587.909572:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789601587.909639:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789601587.909681:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789601587.912914:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789601587.913802:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789601587.914192:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789601587.914264:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789601587.914307:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789601587.914363:0:15138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00663480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880573056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789601587.914448:0:15138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601587.914497:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880573056 00000100:00100000:1.0:1789601587.914505:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880573056 00000100:00100000:1.0:1789601587.914556:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789601587.914566:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:15138:x1876532880573056:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789601587.918402:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:15138:x1876532880573056:12345-0@lo:502:mount.lustre.0 Request processed in 3824us (3941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601587.918419:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789601587.918506:0:15138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc23d1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789601587.918535:0:15138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00663480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880573056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789601587.918674:0:15138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789601587.919176:0:15138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789601587.923332:0:15161:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789601587.923353:0:15161:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff91edc60119c0) 00000020:00000080:1.0:1789601587.923378:0:15161:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789601587.923456:0:15161:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91ee00b08800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789601587.923460:0:15161:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91ee00b08800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789601587.923463:0:15161:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91ee00b08800 3 00010000:00080000:1.0:1789601587.923517:0:15161:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91ee00c88000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.130@tcp at head 00010000:00010000:1.0:1789601587.926549:0:15161:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1789601587.928282:0:15161:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789601587.928332:0:15161:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789601587.928346:0:15161:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf3d6e402158ad0a5 00000100:00080000:1.0:1789601587.928361:0:15161:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789601587.928374:0:15161:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91ee00c88000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1789601587.928416:0:15161:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ee00663480 x1876532880573184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789601587.928445:0:15161:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1789601587.934191:0:15161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1789601587.934289:0:15138:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789601587.934317:0:15138:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789601587.934339:0:15138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5e00/0xf3d6e402158ad090 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad097 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601587.934352:0:15138:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc29c5e00/0xf3d6e402158ad090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad097 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789601587.934406:0:15138:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789601587.934409:0:15138:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789601587.934411:0:15138:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601587.934412:0:15138:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789601587.934418:0:15138:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601587.934420:0:15138:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601587.934421:0:15138:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789601587.934423:0:15138:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601587.934424:0:15138:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789601587.934428:0:15138:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789601587.934430:0:15138:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789601587.934431:0:15138:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789601587.934432:0:15138:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601587.934433:0:15138:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789601587.934434:0:15138:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601587.934435:0:15138:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601587.934435:0:15138:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789601587.934436:0:15138:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601587.934437:0:15138:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789601587.934462:0:15138:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789601587.934482:0:15138:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00660700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880573312:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789601587.934552:0:15138:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601587.934600:0:15138:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc23d1540 going to sleep for 11 seconds 00000100:00100000:2.0:1789601587.935864:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880573312 00000100:00100000:2.0:1789601587.935876:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880573312 00000100:00100000:2.0:1789601587.935934:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789601587.936075:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:15138:x1876532880573312:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789601587.936109:0:14449:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789601587.936123:0:14449:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789601587.936495:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1876532880573184:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789601587.936557:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789601587.936622:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789601587.936634:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789601587.936637:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789601587.936639:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789601587.937385:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880573184 00000100:00100000:2.0:1789601587.937393:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880573184 00000100:00100000:2.0:1789601587.937422:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789601587.937428:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3316:x1876532880573184:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789601587.937449:0:14454:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:2.0:1789601587.937484:0:14454:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf3d6e402158ad0ac 00000004:00100000:2.0:1789601587.937498:0:14454:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789601587.937527:0:14454:0:(import.c:65:import_set_state_nolock()) ffff91edf9d56800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789601587.937586:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3316:x1876532880573184:12345-0@lo:38:llog_process_th.0 Request processed in 157us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601587.937593:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789601587.937631:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880573440:0@lo:400:kworker.0 00000100:00100000:2.0:1789601587.937659:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601587.937705:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880573440 00000100:00100000:2.0:1789601587.937709:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880573440 00000100:00100000:2.0:1789601587.937731:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789601587.937736:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880573440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601587.937767:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880573440:12345-0@lo:400:kworker.0 Request processed in 31us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601587.937773:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789601587.937802:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91ee00663480 x1876532880573184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789601597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601587.937824:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789601587.937833:0:3316:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789601587.937856:0:3316:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789601587.937861:0:3316:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789601587.937864:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91ee00c88000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789601587.937870:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3316:1876532880573184:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789601587.937905:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91ecc2c6ce00 x1876532880573440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601587.937914:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880573440:0@lo:400:kworker.0 20000000:01000000:3.0:1789601587.980482:0:14449:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789601587.980506:0:14449:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789601587.982291:0:14470:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789601587.982300:0:14470:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789601587.982323:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91edd8d8c400/0xf3d6e402158ad0b3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601587.982342:0:14470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edffadd400/0xf3d6e402158ad020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ad019 expref: 16 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601587.982350:0:14470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91edd8d8c400/0xf3d6e402158ad0b3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601587.982394:0:14470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edffadd400/0xf3d6e402158ad020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158ad019 expref: 16 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601587.982408:0:14470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91edffadd400/0xf3d6e402158ad020 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158ad019 expref: 16 pid: 14447 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601587.982423:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14470:1876532880573568:0@lo:104: 00000100:00100000:2.0:1789601587.982500:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601587.982557:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede03d6480 going to sleep for 11 seconds 00000100:00100000:3.0:1789601587.982639:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880573568 00000100:00100000:3.0:1789601587.982647:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880573568 00000100:00100000:3.0:1789601587.982699:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789601587.982709:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+3:14470:x1876532880573568:12345-0@lo:104: 00010000:00010000:3.0:1789601587.982730:0:14438:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edd8d8d800/0xf3d6e402158ad019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158ad020 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.982791:0:14438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789601587.982796:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+3:14470:x1876532880573568:12345-0@lo:104: Request processed in 90us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601587.982803:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789601587.982826:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601587.982868:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edd8d8d800/0xf3d6e402158ad019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158ad020 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.982876:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d800 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:3.0:1789601587.982881:0:14442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edd8d8d800/0xf3d6e402158ad019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158ad020 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.982890:0:14442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edd8d8d800/0xf3d6e402158ad019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158ad020 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789601587.982897:0:14442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edd8d8d800/0xf3d6e402158ad019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158ad020 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601587.982902:0:14442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789601587.982932:0:14442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edd8d8d800/0xf3d6e402158ad019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ad020 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.982951:0:14442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789601587.983223:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14470:1876532880573568:0@lo:104: 00010000:00010000:2.0:1789601587.983245:0:14470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91edd8d8c400/0xf3d6e402158ad0b3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.983420:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edd8d8d800/0xf3d6e402158ad019 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ad020 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.983428:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edd8d8d800/0xf3d6e402158ad019 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ad020 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.983446:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601587.983448:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601587.983449:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601587.983464:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789601587.983475:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3319:1876532880573696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601587.983512:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601587.983560:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880573696 00000100:00100000:3.0:1789601587.983564:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880573696 00010000:00010000:3.0:1789601587.983586:0:14440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edffadd400/0xf3d6e402158ad020 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158ad019 expref: 17 pid: 14447 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601587.983622:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789601587.983629:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+17:3319:x1876532880573696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789601587.983640:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601587.983645:0:14440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edffadd400/0xf3d6e402158ad020 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158ad019 expref: 17 pid: 14447 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.983655:0:14440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edffadd400/0xf3d6e402158ad020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158ad019 expref: 17 pid: 14447 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.983667:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edffadd400/0xf3d6e402158ad020 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158ad019 expref: 17 pid: 14447 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.983895:0:14440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91edd8d8c400/0xf3d6e402158ad0b3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.983905:0:14440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edd8d8c400/0xf3d6e402158ad0b3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789601587.983919:0:14440:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008610730s 00010000:00010000:3.0:1789601587.983925:0:14440:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edd8d8c400/0xf3d6e402158ad0b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.983932:0:14440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edd8d8c400/0xf3d6e402158ad0b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.983940:0:14440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91edd8d8c400/0xf3d6e402158ad0b3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.983947:0:14440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91edd8d8c400/0xf3d6e402158ad0b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.983953:0:14440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c400 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601587.983957:0:14440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91edd8d8c400/0xf3d6e402158ad0b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.984153:0:14440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91edd8d8c400/0xf3d6e402158ad0b3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601587.984525:0:14470:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91edd8d8c400/0xf3d6e402158ad0b3 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601587.984534:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91edd8d8c400/0xf3d6e402158ad0b3 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.984567:0:14440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91edd8d8c400/0xf3d6e402158ad0b3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.984576:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edd8d8c400/0xf3d6e402158ad0b3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601587.984613:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601587.984882:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:3319:x1876532880573696:12345-0@lo:103:ldlm_bl.0 Request processed in 1251us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601587.984891:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789601587.987232:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3319:1876532880573696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601587.990710:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+15:15138:x1876532880573312:12345-0@lo:253:mount.lustre.0 Request processed in 54747us (56137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601587.990734:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789601587.991169:0:15138:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00660700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15138:1876532880573312:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789601587.991186:0:15138:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789601587.991189:0:15138:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789601587.991191:0:15138:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789601587.991192:0:15138:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601587.991194:0:15138:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789601587.991195:0:15138:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601587.991196:0:15138:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601587.991197:0:15138:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789601587.991199:0:15138:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601587.991201:0:15138:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789601587.991218:0:15138:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789601587.997217:0:15138:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789601587.997374:0:15138:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789601587.997530:0:15138:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789601587.998381:0:15138:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789601587.998593:0:15138:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789601587.999127:0:15138:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789601588.000256:0:15138:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789601588.071669:0:15138:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789601588.071677:0:15138:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789601588.071919:0:15138:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789601588.072145:0:15138:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789601588.072162:0:15138:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789601588.072194:0:15138:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789601588.491231:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601589.512945:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789601589.704919:0:14451:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789601589.704927:0:14451:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91edc5026000 from 7 10000000:01000000:3.0:1789601589.704932:0:14451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789601589.704977:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadd400/0xf3d6e402158ad0ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601589.704989:0:14451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edffadd400/0xf3d6e402158ad0ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601589.705001:0:14451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edffadd400/0xf3d6e402158ad0ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601589.705027:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880573824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789601589.705099:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601589.705151:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede0714600 going to sleep for 11 seconds 00000100:00100000:0.0:1789601589.705254:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880573824 00000100:00100000:0.0:1789601589.705263:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880573824 00000100:00100000:0.0:1789601589.705321:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789601589.705329:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+15:14451:x1876532880573824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789601589.705342:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601589.705355:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ee00924400/0xf3d6e402158ad0c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158ad0ba expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601589.705392:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ee00924400/0xf3d6e402158ad0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158ad0ba expref: 16 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601589.705404:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ee00924400/0xf3d6e402158ad0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ad0ba expref: 16 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601589.705413:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924400, rc 0) 00000100:00100000:0.0:1789601589.705459:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:14451:x1876532880573824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601589.705466:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789601589.705622:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880573824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601589.705637:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edffadd400/0xf3d6e402158ad0ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad0c1 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601589.705658:0:14451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edffadd400/0xf3d6e402158ad0ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ad0c1 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601589.705718:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880573952:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789601589.705755:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601589.705779:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede0714600 going to sleep for 11 seconds 00000100:00100000:0.0:1789601589.705964:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880573952 00000100:00100000:0.0:1789601589.705969:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880573952 00000100:00100000:0.0:1789601589.705992:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789601589.705999:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:14451:x1876532880573952:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789601589.706012:0:14449:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789601589.706028:0:14449:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789601589.706032:0:14449:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789601589.706109:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:14451:x1876532880573952:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601589.706116:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789601589.706145:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880573952:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789601589.706204:0:14451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789601589.706215:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edffadd400/0xf3d6e402158ad0ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad0c1 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601589.706224:0:14451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edffadd400/0xf3d6e402158ad0ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad0c1 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601590.537762:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601591.565963:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789601592.401426:0:14486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789601592.585203:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789601593.293232:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789601593.293240:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789601593.293243:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789601593.293246:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789601593.293304:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880574208:0@lo:400:kworker.0 00000100:00100000:3.0:1789601593.293386:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601593.293444:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789601593.293451:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3318:1876532880574080:0@lo:400:kworker.0 00000100:00100000:3.0:1789601593.293493:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601593.293894:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880574336:0@lo:400:kworker.0 00000100:00100000:3.0:1789601593.293927:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601593.293970:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880574208 00000100:00100000:3.0:1789601593.293978:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880574208 00000100:00100000:3.0:1789601593.294020:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880574336 00000100:00100000:3.0:1789601593.294024:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880574336 00000100:00100000:3.0:1789601593.294060:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789601593.294067:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880574208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601593.294121:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880574208:12345-0@lo:400:kworker.0 Request processed in 54us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601593.294128:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789601593.294149:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789601593.294155:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880574336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601593.294202:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880574336:12345-0@lo:400:kworker.0 Request processed in 47us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601593.294351:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789601593.294373:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880574080 00000100:00100000:3.0:1789601593.294377:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880574080 00000100:00100000:3.0:1789601593.294442:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789601593.294450:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:3318:x1876532880574080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601593.294495:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:3318:x1876532880574080:12345-0@lo:400:kworker.0 Request processed in 46us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601593.294501:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1789601593.294650:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601593.301310:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3318:1876532880574080:0@lo:400:kworker.0 00010000:00080000:0.0:1789601593.301336:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edf8b1d180 x1876532880574208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601593.301351:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880574208:0@lo:400:kworker.0 00010000:00080000:3.0:1789601593.314091:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91edf8b1e680 x1876532880574336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601593.314113:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880574336:0@lo:400:kworker.0 00010000:00010000:1.0:1789601593.610884:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601594.634194:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601595.081158:0:3316:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789601580/real 1789601580] req@ffff91ee00661f80 x1876532880569600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601595 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601595.081208:0:3316:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91ee00661f80 x1876532880569600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601595 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601595.081217:0:3316:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789601580/real 1789601580] req@ffff91ee00662300 x1876532880569728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601595 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601595.081230:0:3316:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91ee00662300 x1876532880569728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789601595 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789601595.081249:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91edc601c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789601595.081342:0:3316:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789601595.081347:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880569600:0@lo:8:kworker.0 00000100:00080000:1.0:1789601595.081353:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91eddccc1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789601595.084146:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601595.084153:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789601595.084157:0:38:0:(import.c:65:import_set_state_nolock()) ffff91edc601c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789601595.084165:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:0.0:1789601595.084171:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789601595.084291:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91edc601c000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1789601595.084315:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ecc2ed3b80 x1876532880574592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789601595.084327:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789601595.084330:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789601595.084396:0:38:0:(import.c:65:import_set_state_nolock()) ffff91eddccc1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789601595.084400:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:0.0:1789601595.084403:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789601595.084417:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eddccc1000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:0.0:1789601595.084434:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ecc2ed3800 x1876532880574720/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789601595.084500:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3320:1876532880574464:0@lo:400:kworker.0 00000100:00080000:1.0:1789601595.084829:0:3316:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789601595.084964:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601595.085107:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880569728:0@lo:8:kworker.0 00000100:00100000:1.0:1789601595.085132:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880574592:0@lo:8:kworker.0 00000100:00100000:1.0:1789601595.085168:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601595.085317:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880574848:0@lo:400:kworker.0 00000100:00100000:1.0:1789601595.085420:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880574720:0@lo:8:kworker.0 00000100:00100000:1.0:1789601595.085443:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601595.085500:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880574592 00000100:00100000:1.0:1789601595.085508:0:15140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880574592 00000100:00100000:0.0:1789601595.085727:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601595.085751:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601595.085758:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880574976:0@lo:400:kworker.0 00000100:00100000:0.0:1789601595.085785:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601595.085819:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880574464 00000100:00100000:0.0:1789601595.085824:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880574464 00000100:00100000:1.0:1789601595.085936:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880574720 00000100:00100000:1.0:1789601595.085948:0:15140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880574720 00000100:00100000:1.0:1789601595.085966:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789601595.085974:0:15140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3316:x1876532880574592:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789601595.086003:0:15140:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 465 last 0 00000100:00100000:0.0:1789601595.086131:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789601595.086138:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:3320:x1876532880574464:12345-0@lo:400:kworker.0 00000020:00000080:1.0:1789601595.086307:0:15140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3d6e402158ad0c8 00002000:00100000:1.0:1789601595.086323:0:15140:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff91ee00c8a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789601595.086327:0:15140:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789601595.086330:0:15140:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1789601595.086418:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:3320:x1876532880574464:12345-0@lo:400:kworker.0 Request processed in 279us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601595.086427:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789601595.086469:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880574848 00000100:00100000:0.0:1789601595.086473:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880574848 00000100:00100000:0.0:1789601595.086509:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880574976 00000100:00100000:0.0:1789601595.086512:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880574976 00000100:00100000:0.0:1789601595.086557:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789601595.086564:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880574848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601595.087114:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880574848:12345-0@lo:400:kworker.0 Request processed in 549us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601595.087123:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789601595.087147:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789601595.087154:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880574976:12345-0@lo:400:kworker.0 00002000:00080000:1.0:1789601595.087577:0:15140:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1789601595.087681:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880574976:12345-0@lo:400:kworker.0 Request processed in 526us (1894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601595.087689:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789601595.087731:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789601595.087766:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ecc2ed1180 x1876532880574976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601595.087783:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880574976:0@lo:400:kworker.0 00010000:00080000:0.0:1789601595.087796:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ecc2ed3480 x1876532880574848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601595.087804:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880574848:0@lo:400:kworker.0 00000100:00100000:0.0:1789601595.088136:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3320:1876532880574464:0@lo:400:kworker.0 00000100:00080000:1.0:1789601595.088501:0:15140:0:(import.c:65:import_set_state_nolock()) ffff91ee00c8b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789601595.091183:0:15140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1876532880574592:12345-0@lo:8:kworker.0 Request processed in 5199us (6006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601595.091198:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789601595.091242:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789601595.091249:0:15140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3316:x1876532880574720:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789601595.091272:0:15140:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789601595.091308:0:15140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3316:x1876532880574720:12345-0@lo:8:kworker.0 Request processed in 59us (5864us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789601595.091313:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789601595.093362:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ecc2ed3b80 x1876532880574592/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789601615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601595.093378:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789601595.093390:0:3316:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789601595.093403:0:3316:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789601595.093411:0:3316:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789601595.093415:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91edc601c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789601595.093485:0:3316:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789601595.093493:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880574592:0@lo:8:kworker.0 00000100:00080000:3.0:1789601595.093515:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91eddccc1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789601595.093519:0:3316:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789601595.093522:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880574720:0@lo:8:kworker.0 00000004:00080000:2.0:1789601595.093607:0:14476:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789601595.093638:0:14477:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1789601595.093665:0:14477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14477:1876532880575232:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789601595.093743:0:14477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601595.093779:0:14477:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8d03540 going to sleep for 11 seconds 00000100:00100000:0.0:1789601595.093815:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880575232 00000100:00100000:0.0:1789601595.093822:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880575232 00000100:00100000:0.0:1789601595.093903:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789601595.093915:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14477:x1876532880575232:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789601595.094219:0:14476:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 465132380668ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789601595.094797:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880575104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601595.094900:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789601595.095305:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601595.103679:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880575104 00000100:00100000:2.0:1789601595.103696:0:15143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880575104 00000100:00100000:2.0:1789601595.103744:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789601595.103756:0:15143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1876532880575104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789601595.103792:0:15143:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789601595.103944:0:15143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3319:x1876532880575104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 190us (9046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601595.103950:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789601595.106825:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ecc2ed0e00 x1876532880575104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789601595.108600:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880575104:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1789601595.118710:0:15141:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789601595.118722:0:15141:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1789601595.118727:0:15141:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:0.0:1789601595.142242:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.142256:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.142273:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.142278:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.142284:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.142301:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.142311:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.142320:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.142445:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789601595.142460:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601595.142466:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.142484:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925800 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601595.142489:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.142514:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.142539:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.142704:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.142725:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.142727:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.142729:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789601595.144939:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.144953:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad0d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.144968:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.144973:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.144980:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad0d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.144994:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad0d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.145004:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad0d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.145031:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad0d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.145050:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789601595.146163:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.146174:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad0dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.146188:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.146192:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.146197:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad0dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.146209:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad0dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.146218:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad0dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.146226:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad0dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.146248:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789601595.146266:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789601595.146272:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad0d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.146286:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924200 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601595.146291:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad0d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.146300:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad0d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.146316:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad0d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.146325:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad0d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.146350:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601595.147242:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.147244:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.147246:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601595.147565:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601595.147574:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad0dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.147587:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924a00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601595.147591:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad0dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.147600:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad0dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.147618:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad0dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.147625:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad0dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.147640:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601595.147642:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601595.147643:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601595.147654:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601595.147655:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789601595.148206:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.148215:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad0e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.148227:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.148231:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.148237:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad0e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.148248:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad0e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.148264:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad0e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.148272:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad0e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.148288:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789601595.148298:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601595.148301:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad0e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.148309:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925400 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601595.148312:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad0e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.148320:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad0e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.148337:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad0e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.148345:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad0e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.148359:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.148367:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.148369:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789601595.150363:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.150376:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad0eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.150391:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.150396:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.150403:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad0eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.150417:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad0eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.150427:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad0eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.150435:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad0eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.150455:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789601595.150469:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601595.150485:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad0eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.150492:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925e00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601595.150497:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad0eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.150527:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad0eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.150546:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad0eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.150681:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad0eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.150707:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.150709:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.150711:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789601595.151458:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.151465:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.151485:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.151489:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.151494:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.151506:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.151514:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.151528:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.151804:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789601595.151815:0:15467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601595.151820:0:15467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.151828:0:15467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925800 already unused, calling callback (ffffffffc17c18b0) 00002000:00010000:1.0:1789601595.152252:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789601595.152260:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d293a4/0xf3d6e402158ad0f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.152270:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1789601595.152273:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601595.152277:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d293a4/0xf3d6e402158ad0f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.152298:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d293a4/0xf3d6e402158ad0f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.152306:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001d293a4/0xf3d6e402158ad0f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.152312:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001d293a4/0xf3d6e402158ad0f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.152326:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789601595.152884:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789601595.152890:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000094f1806/0xf3d6e402158ad100 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.152901:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1789601595.152905:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601595.152909:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000094f1806/0xf3d6e402158ad100 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.152919:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000094f1806/0xf3d6e402158ad100 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.152928:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000094f1806/0xf3d6e402158ad100 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.152948:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000094f1806/0xf3d6e402158ad100 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.152964:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789601595.153336:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789601595.153343:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000559d79b6/0xf3d6e402158ad107 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.153353:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=465s v=(0 0) 00010000:00010000:1.0:1789601595.153356:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601595.153360:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000559d79b6/0xf3d6e402158ad107 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.153370:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000559d79b6/0xf3d6e402158ad107 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.153378:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000559d79b6/0xf3d6e402158ad107 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.153387:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000559d79b6/0xf3d6e402158ad107 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.153396:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789601595.153904:0:15467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.153917:0:15467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.153939:0:15467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.153949:0:15467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066b93ee4/0xf3d6e402158ad0f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.153973:0:15467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789601595.153978:0:15467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001d293a4/0xf3d6e402158ad0f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.153999:0:15467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4200 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601595.154003:0:15467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d293a4/0xf3d6e402158ad0f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.154011:0:15467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001d293a4/0xf3d6e402158ad0f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.154022:0:15467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001d293a4/0xf3d6e402158ad0f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.154030:0:15467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d293a4/0xf3d6e402158ad0f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.154044:0:15467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789601595.154048:0:15467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000094f1806/0xf3d6e402158ad100 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.154054:0:15467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4a00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601595.154057:0:15467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000094f1806/0xf3d6e402158ad100 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.154066:0:15467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000094f1806/0xf3d6e402158ad100 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.154076:0:15467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000094f1806/0xf3d6e402158ad100 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.154089:0:15467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000094f1806/0xf3d6e402158ad100 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.154102:0:15467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601595.154106:0:15467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000559d79b6/0xf3d6e402158ad107 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.154112:0:15467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5600 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601595.154115:0:15467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000559d79b6/0xf3d6e402158ad107 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.154123:0:15467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000559d79b6/0xf3d6e402158ad107 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.154134:0:15467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000559d79b6/0xf3d6e402158ad107 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.154142:0:15467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000559d79b6/0xf3d6e402158ad107 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.154155:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.154157:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.154159:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.154172:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.154178:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789601595.155154:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.155168:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad10e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.155180:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.155185:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.155191:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad10e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.155203:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad10e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.155212:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad10e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.155219:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad10e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.155275:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789601595.156081:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.156089:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad115 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.156100:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.156103:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.156108:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad115 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.156118:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad115 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.156133:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad115 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.156140:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad115 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.156343:0:15467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789601595.156353:0:15467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad10e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.156371:0:15467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924800 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601595.156375:0:15467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad10e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.156384:0:15467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad10e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.156401:0:15467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad10e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.156410:0:15467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad10e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.156435:0:15467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601595.156440:0:15467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad115 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.156447:0:15467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925c00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601595.156451:0:15467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad115 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.156459:0:15467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad115 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.156470:0:15467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad115 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.157192:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601595.157196:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601595.157198:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.157457:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789601595.157464:0:15141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad115 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789601595.159290:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.159303:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad11c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.159320:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.159324:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.159331:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad11c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.159345:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad11c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.159356:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad11c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.159377:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad11c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.163015:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601595.163032:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad11c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.163047:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924a00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601595.163053:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad11c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.163065:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad11c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.163086:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad11c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.163096:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601595.163098:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601595.163100:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.163445:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789601595.163453:0:15141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad11c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.164751:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789601595.169820:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.169833:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad123 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.169887:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.169892:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.169898:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad123 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.169912:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad123 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.169922:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad123 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.169930:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad123 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.169959:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789601595.170566:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.170573:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad12a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.170581:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.170584:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.170587:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad12a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.170596:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad12a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.170604:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad12a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.170611:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad12a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.170622:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789601595.171029:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.171035:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad131 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.171043:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.171052:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.171056:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad131 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.171066:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad131 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.171074:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad131 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.171081:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad131 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.171096:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789601595.171467:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.171485:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000271ce4f2/0xf3d6e402158ad138 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.171494:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.171497:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.171501:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000271ce4f2/0xf3d6e402158ad138 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.171511:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000271ce4f2/0xf3d6e402158ad138 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.171520:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000271ce4f2/0xf3d6e402158ad138 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.171534:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000271ce4f2/0xf3d6e402158ad138 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.171542:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1789601595.171943:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.171948:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3c90595/0xf3d6e402158ad13f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.171956:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.171959:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.171963:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3c90595/0xf3d6e402158ad13f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.171971:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3c90595/0xf3d6e402158ad13f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.171979:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3c90595/0xf3d6e402158ad13f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.171986:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3c90595/0xf3d6e402158ad13f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.171993:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1789601595.172384:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.172390:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2e1147/0xf3d6e402158ad146 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.172404:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.172407:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.172411:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2e1147/0xf3d6e402158ad146 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.172420:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae2e1147/0xf3d6e402158ad146 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.172428:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae2e1147/0xf3d6e402158ad146 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.172434:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae2e1147/0xf3d6e402158ad146 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.172443:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1789601595.172621:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789601595.172630:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad123 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172639:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925e00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601595.172650:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad123 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172659:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad123 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172677:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad123 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172684:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad123 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172707:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789601595.172711:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad12a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172718:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925400 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601595.172722:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad12a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172728:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad12a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172737:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad12a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172743:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d5ffc4d/0xf3d6e402158ad12a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172763:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789601595.172766:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad131 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172772:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924200 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601595.172775:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad131 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172783:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad131 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172793:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad131 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172800:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008151cf21/0xf3d6e402158ad131 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172813:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789601595.172816:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000271ce4f2/0xf3d6e402158ad138 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172821:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0031c00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601595.172824:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000271ce4f2/0xf3d6e402158ad138 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172859:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000271ce4f2/0xf3d6e402158ad138 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172869:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000271ce4f2/0xf3d6e402158ad138 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172876:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000271ce4f2/0xf3d6e402158ad138 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172890:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789601595.172893:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3c90595/0xf3d6e402158ad13f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172898:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0031000 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601595.172901:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3c90595/0xf3d6e402158ad13f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172908:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3c90595/0xf3d6e402158ad13f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172916:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3c90595/0xf3d6e402158ad13f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172922:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3c90595/0xf3d6e402158ad13f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172943:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601595.172947:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae2e1147/0xf3d6e402158ad146 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172954:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0031800 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601595.172957:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2e1147/0xf3d6e402158ad146 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172964:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae2e1147/0xf3d6e402158ad146 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172975:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae2e1147/0xf3d6e402158ad146 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172981:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae2e1147/0xf3d6e402158ad146 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.172992:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601595.172994:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601595.172996:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601595.173005:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601595.173031:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789601595.175028:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.175041:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005524d4d/0xf3d6e402158ad14d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.175057:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.175062:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.175068:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005524d4d/0xf3d6e402158ad14d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.175081:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005524d4d/0xf3d6e402158ad14d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.175105:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005524d4d/0xf3d6e402158ad14d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.175114:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005524d4d/0xf3d6e402158ad14d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.175136:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789601595.176094:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.176102:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2240671/0xf3d6e402158ad154 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.176112:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.176116:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.176120:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2240671/0xf3d6e402158ad154 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.176131:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2240671/0xf3d6e402158ad154 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.176138:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2240671/0xf3d6e402158ad154 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.176146:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2240671/0xf3d6e402158ad154 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.176222:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789601595.176923:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.176930:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b49902f/0xf3d6e402158ad15b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.176940:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.176943:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.176948:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b49902f/0xf3d6e402158ad15b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.176957:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b49902f/0xf3d6e402158ad15b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.176966:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b49902f/0xf3d6e402158ad15b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.176972:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b49902f/0xf3d6e402158ad15b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.178096:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789601595.178110:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005524d4d/0xf3d6e402158ad14d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.178135:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0031400 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601595.178139:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005524d4d/0xf3d6e402158ad14d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.178149:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005524d4d/0xf3d6e402158ad14d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.178171:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005524d4d/0xf3d6e402158ad14d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.178179:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005524d4d/0xf3d6e402158ad14d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.178205:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789601595.178208:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2240671/0xf3d6e402158ad154 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.178214:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030a00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601595.178217:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2240671/0xf3d6e402158ad154 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.178223:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2240671/0xf3d6e402158ad154 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.178231:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2240671/0xf3d6e402158ad154 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.178244:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2240671/0xf3d6e402158ad154 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.178256:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601595.178259:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b49902f/0xf3d6e402158ad15b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.178265:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030600 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601595.178267:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b49902f/0xf3d6e402158ad15b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.178275:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b49902f/0xf3d6e402158ad15b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.178283:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b49902f/0xf3d6e402158ad15b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.178289:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601595.178291:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601595.178293:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601595.178429:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789601595.178436:0:15141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b49902f/0xf3d6e402158ad15b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789601595.178469:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1789601595.178693:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789601595.179390:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.179406:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad162 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.179421:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.179426:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.179431:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad162 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.179446:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad162 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.179456:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad162 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.179464:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad162 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.179488:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601595.179745:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601595.179753:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad162 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.179761:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0031e00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601595.179772:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad162 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.179781:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad162 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.179795:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad162 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.179803:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad162 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.179821:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601595.179822:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601595.179824:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789601595.180723:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.180731:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad169 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.180741:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.180744:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.180749:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad169 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.180760:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad169 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.180775:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad169 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.180783:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad169 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.180883:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789601595.181262:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.181268:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fea07bf/0xf3d6e402158ad170 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.181277:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.181281:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.181285:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fea07bf/0xf3d6e402158ad170 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.181295:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fea07bf/0xf3d6e402158ad170 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.181303:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007fea07bf/0xf3d6e402158ad170 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.181311:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fea07bf/0xf3d6e402158ad170 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.181346:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789601595.181732:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.181738:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f13124c/0xf3d6e402158ad177 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.181747:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.181750:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.181755:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f13124c/0xf3d6e402158ad177 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.181764:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f13124c/0xf3d6e402158ad177 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.181772:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f13124c/0xf3d6e402158ad177 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.181780:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f13124c/0xf3d6e402158ad177 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.181787:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789601595.182163:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.182170:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad17e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.182178:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.182185:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.182190:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad17e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.182199:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad17e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.182207:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad17e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.182214:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad17e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.182221:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1789601595.183037:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789601595.183046:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad169 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183067:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030c00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601595.183072:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad169 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183083:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad169 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183100:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad169 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183107:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad169 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183123:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789601595.183126:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fea07bf/0xf3d6e402158ad170 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183132:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030e00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601595.183135:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fea07bf/0xf3d6e402158ad170 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183141:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fea07bf/0xf3d6e402158ad170 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183150:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fea07bf/0xf3d6e402158ad170 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183163:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fea07bf/0xf3d6e402158ad170 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183175:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789601595.183179:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f13124c/0xf3d6e402158ad177 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183185:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030800 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601595.183188:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f13124c/0xf3d6e402158ad177 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183196:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f13124c/0xf3d6e402158ad177 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183205:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f13124c/0xf3d6e402158ad177 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183212:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f13124c/0xf3d6e402158ad177 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183224:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601595.183228:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad17e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183234:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924a00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601595.183243:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad17e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183251:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad17e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183261:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad17e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183268:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9fd42da/0xf3d6e402158ad17e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601595.183280:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601595.183282:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601595.183283:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601595.185055:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789601595.185094:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.185108:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad185 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.185127:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.185132:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.185138:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad185 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.185152:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad185 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.185162:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad185 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.185177:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad185 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.185206:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601595.185750:0:15467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601595.185763:0:15467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad185 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.185772:0:15467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924800 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601595.185776:0:15467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad185 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.185785:0:15467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad185 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.185806:0:15467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad185 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601595.185822:0:15467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad185 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.187336:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601595.187745:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601595.187749:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601595.187751:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789601595.191535:0:15141:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789601595.191659:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad18c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.191780:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1789601595.191785:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601595.191792:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad18c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.191808:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad18c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.191819:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad18c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.191828:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad18c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601595.192232:0:15141:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789601595.192591:0:15141:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1789601595.192699:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14477:x1876532880575232:12345-0@lo:5:osp-pre-0-0.0 Request processed in 98784us (98953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601595.192714:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789601595.192767:0:14477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14477:1876532880575232:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789601595.192781:0:14477:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1789601595.192825:0:14477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14477:1876532880575360:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789601595.192892:0:14477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601595.192930:0:14477:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc50bbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789601595.192947:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880575360 00000100:00100000:0.0:1789601595.192953:0:15140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880575360 00000100:00100000:0.0:1789601595.192990:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789601595.192992:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789601595.192998:0:15140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14477:x1876532880575360:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1789601595.193002:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad18c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.193014:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925c00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601595.193020:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad18c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.193030:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad18c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789601595.193034:0:15140:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1789601595.193056:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad18c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.193065:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003967d52f/0xf3d6e402158ad18c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601595.193087:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601595.193090:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601595.193091:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601595.219691:0:15140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14477:x1876532880575360:12345-0@lo:5:osp-pre-0-0.0 Request processed in 26683us (26787us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789601595.219705:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601595.222073:0:14477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14477:1876532880575360:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789601595.222094:0:14477:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:02000400:0.0:1789601595.601795:0:15506:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789601595.658033:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601596.693197:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601597.705208:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789601598.564242:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1789601598.564328:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789601598.732947:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601599.755312:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601600.457158:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880575488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601600.457278:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789601600.457617:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789601600.457622:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789601600.457628:0:8:0:(import.c:65:import_set_state_nolock()) ffff91eddccc1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789601600.457634:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:2.0:1789601600.457641:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789601600.457654:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eddccc1000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1789601600.457684:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ecc2c6d500 x1876532880575744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789601600.457740:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880575872:0@lo:400:kworker.0 00000100:00100000:2.0:1789601600.457781:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601600.457817:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789601600.457823:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3318:1876532880575616:0@lo:400:kworker.0 00000100:00100000:2.0:1789601600.457897:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601600.457929:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880575744:0@lo:8:kworker.0 00000100:00100000:2.0:1789601600.457972:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601600.458008:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880575872 00000100:00100000:2.0:1789601600.458019:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880575872 00000100:00100000:2.0:1789601600.458072:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789601600.458082:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880575872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601600.458139:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880575872:12345-0@lo:400:kworker.0 Request processed in 59us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601600.458146:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789601600.458179:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880575744 00000100:00100000:2.0:1789601600.458182:0:15142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880575744 00000100:00100000:2.0:1789601600.458198:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789601600.458203:0:15142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3316:x1876532880575744:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789601600.458238:0:15142:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789601600.458714:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880575616 00000100:00100000:3.0:1789601600.458721:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880575616 00000100:00100000:3.0:1789601600.458760:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789601600.458767:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:3318:x1876532880575616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601600.458812:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:3318:x1876532880575616:12345-0@lo:400:kworker.0 Request processed in 46us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601600.458818:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789601600.461740:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880575488 00000100:00100000:0.0:1789601600.461766:0:15143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880575488 00000100:00100000:0.0:1789601600.462088:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789601600.462103:0:15143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880575488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789601600.462160:0:15143:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789601600.462271:0:15143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880575488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (4991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601600.462280:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789601600.462344:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601600.466185:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880576000:0@lo:400:kworker.0 00000100:00100000:3.0:1789601600.466296:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601600.466424:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789601600.466457:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880575488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601600.467105:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880576000 00000100:00100000:0.0:1789601600.467119:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880576000 00000100:00100000:0.0:1789601600.467186:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789601600.467199:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880576000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601600.467298:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880576000:12345-0@lo:400:kworker.0 Request processed in 100us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601600.467307:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789601600.467350:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ecc2c6df80 x1876532880576000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601600.467364:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880576000:0@lo:400:kworker.0 00000100:00080000:0.0:1789601600.467405:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601600.483010:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3318:1876532880575616:0@lo:400:kworker.0 00010000:00080000:0.0:1789601600.483049:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ecc2c6e300 x1876532880575872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601600.483065:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880575872:0@lo:400:kworker.0 00000100:00100000:2.0:1789601600.491802:0:15142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3316:x1876532880575744:12345-0@lo:8:kworker.0 Request processed in 33582us (33814us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789601600.491823:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789601600.497033:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91eddccc1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789601600.497051:0:3316:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789601600.497057:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880575744:0@lo:8:kworker.0 00010000:00010000:3.0:1789601600.779000:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601601.801558:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789601602.634510:0:14486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789601602.829555:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601603.855063:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789601603.984743:0:15856:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789601603.984747:0:15856:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789601603.984916:0:15856:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91edf9d54800 00000020:01000004:2.0:1789601603.984932:0:15856:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789601603.984946:0:15856:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789601603.984959:0:15856:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91edd1748000) 00000020:00000080:2.0:1789601603.984975:0:15856:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789601604.014311:0:15856:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789601604.014606:0:15856:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789601604.016632:0:15856:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789601604.017033:0:15856:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789601604.017434:0:15856:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789601604.017809:0:15856:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 501: rc = 0 00100000:10000000:2.0:1789601604.019609:0:15856:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 501: rc = 0 00100000:10000000:2.0:1789601604.019730:0:15856:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 501: rc = 0 00100000:10000000:2.0:1789601604.020480:0:15856:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:2.0:1789601604.020827:0:15856:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1789601604.021514:0:15856:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:2.0:1789601604.021769:0:15856:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1789601604.022386:0:15856:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:2.0:1789601604.022641:0:15856:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 769: rc = 0 00000020:00000080:2.0:1789601604.023801:0:15856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789601604.023813:0:15856:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789601604.023825:0:15856:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf3d6e402158ad19a 00000020:01000004:2.0:1789601604.023833:0:15856:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789601604.026290:0:15856:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.130@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789601604.026295:0:15856:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789601604.026305:0:15856:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789601604.026354:0:15856:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789601604.026358:0:15856:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789601604.043048:0:15856:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.130@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789601604.043090:0:15856:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.130@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789601604.043096:0:15856:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789601604.043098:0:15856:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789601604.043099:0:15856:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601604.043101:0:15856:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601604.043102:0:15856:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601604.043103:0:15856:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601604.043104:0:15856:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789601604.043106:0:15856:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601604.043107:0:15856:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789601604.043111:0:15856:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789601604.043118:0:15856:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789601604.043120:0:15856:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789601604.043427:0:15856:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601604.043429:0:15856:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601604.043430:0:15856:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601604.043432:0:15856:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601604.043433:0:15856:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789601604.043434:0:15856:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601604.043435:0:15856:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789601604.043459:0:15856:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789601604.043480:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880576128:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789601604.043552:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601604.043659:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd170d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601604.043789:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880576128 00000100:00100000:2.0:1789601604.043798:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880576128 00000100:00100000:2.0:1789601604.043876:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789601604.043885:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:15856:x1876532880576128:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789601604.043922:0:14447:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789601604.043926:0:14447:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789601604.043929:0:14447:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789601604.061269:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:15856:x1876532880576128:12345-0@lo:253:mount.lustre.0 Request processed in 17376us (17707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601604.061302:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789601604.061399:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880576128:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789601604.061414:0:15856:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789601604.061417:0:15856:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789601604.061419:0:15856:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789601604.061421:0:15856:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601604.061422:0:15856:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601604.061423:0:15856:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601604.061424:0:15856:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601604.061426:0:15856:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789601604.061427:0:15856:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601604.061428:0:15856:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789601604.061509:0:15856:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91edf9d54800 from lustre-OST0001 10000000:01000000:0.0:1789601604.061534:0:15856:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789601604.061537:0:15856:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789601604.061545:0:15856:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91edc82c8000 local copy 00010000:00010000:0.0:1789601604.061555:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee00925a00/0xf3d6e402158acf40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acf47 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601604.061777:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880576256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601604.061811:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601604.061987:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc79e4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601604.062069:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880576256 00000100:00100000:3.0:1789601604.062077:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880576256 00000100:00100000:3.0:1789601604.062162:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789601604.062172:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:15856:x1876532880576256:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601604.062449:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:15856:x1876532880576256:12345-0@lo:501:mount.lustre.0 Request processed in 278us (636us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789601604.062455:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789601604.062765:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880576256:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789601604.062783:0:15856:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789601604.063152:0:15856:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789601604.063160:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91ee00925a00/0xf3d6e402158acf40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acf47 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.063171:0:15856:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91ee00925a00/0xf3d6e402158acf40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158acf47 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601604.063207:0:15856:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91edf9d54800 10000000:01000000:1.0:1789601604.063212:0:15856:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789601604.063217:0:15856:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789601604.063219:0:15856:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789601604.063224:0:15856:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789601604.063228:0:15856:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789601604.063258:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ad1a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.063267:0:15856:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ad1a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.063277:0:15856:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ad1a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601604.063296:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00660700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880576384:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789601604.063364:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601604.063777:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc23d1900 going to sleep for 11 seconds 00000100:00100000:0.0:1789601604.064003:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880576384 00000100:00100000:0.0:1789601604.064012:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880576384 00000100:00100000:0.0:1789601604.064048:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789601604.064056:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:15856:x1876532880576384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789601604.064068:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601604.064080:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ee00924a00/0xf3d6e402158ad1a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158ad1a1 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601604.064105:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ee00924a00/0xf3d6e402158ad1a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158ad1a1 expref: 17 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601604.064115:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ee00924a00/0xf3d6e402158ad1a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ad1a1 expref: 17 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601604.064122:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924a00, rc 0) 00000100:00100000:0.0:1789601604.064213:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+17:15856:x1876532880576384:12345-0@lo:101:mount.lustre.0 Request processed in 157us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601604.064219:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789601604.064343:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00660700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880576384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789601604.064359:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ad1a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad1a8 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.064367:0:15856:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ad1a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ad1a8 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789601604.065153:0:15856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789601604.066516:0:15856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789601604.066765:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789601604.066818:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789601604.067103:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789601604.067159:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789601604.067198:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789601604.067234:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789601604.067306:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789601604.067328:0:15856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789601604.067416:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00660700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880576512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789601604.067627:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601604.067996:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc23d1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789601604.068122:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880576512 00000100:00100000:0.0:1789601604.068131:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880576512 00000100:00100000:0.0:1789601604.068215:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789601604.068225:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+17:15856:x1876532880576512:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789601604.068727:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+17:15856:x1876532880576512:12345-0@lo:501:mount.lustre.0 Request processed in 503us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601604.068735:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789601604.068817:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00660700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880576512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789601604.069025:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00660700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880576640:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789601604.069069:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601604.069249:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc23d1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601604.069322:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880576640 00000100:00100000:3.0:1789601604.069328:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880576640 00000100:00100000:3.0:1789601604.069354:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789601604.069372:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+17:15856:x1876532880576640:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789601604.070125:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+17:15856:x1876532880576640:12345-0@lo:503:mount.lustre.0 Request processed in 751us (1051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601604.070135:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789601604.070267:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00660700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880576640:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789601604.071067:0:15856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789601604.071143:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00660700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880576768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789601604.071211:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601604.071303:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc23d1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789601604.071357:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880576768 00000100:00100000:0.0:1789601604.071363:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880576768 00000100:00100000:0.0:1789601604.071515:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789601604.071525:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+17:15856:x1876532880576768:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789601604.071748:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+17:15856:x1876532880576768:12345-0@lo:502:mount.lustre.0 Request processed in 225us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601604.071755:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789601604.071828:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00660700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880576768:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789601604.072175:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789601604.072224:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789601604.072257:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789601604.072327:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789601604.072366:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789601604.072400:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789601604.072462:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789601604.072510:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789601604.072560:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789601604.072592:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00660700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880576896:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789601604.072636:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601604.073040:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc23d1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601604.073112:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880576896 00000100:00100000:3.0:1789601604.073119:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880576896 00000100:00100000:3.0:1789601604.073149:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789601604.073157:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+17:15856:x1876532880576896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601604.073341:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+17:15856:x1876532880576896:12345-0@lo:502:mount.lustre.0 Request processed in 184us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601604.073349:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789601604.073447:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00660700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880576896:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789601604.073522:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789601604.073532:0:15856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1789601604.074559:0:15857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789601604.074570:0:15857:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789601604.074577:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601604.074579:0:15857:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789601604.074585:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789601604.074600:0:15857:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff91edc6013380) 00000020:00000080:1.0:1789601604.074633:0:15857:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789601604.074641:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789601604.074705:0:15857:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91edf9d54800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789601604.074715:0:15857:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789601604.074726:0:15857:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf3d6e402158ad1b6 00010000:00010000:1.0:1789601604.078752:0:15857:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1789601604.079995:0:15857:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1789601604.082650:0:15857:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1789601604.084021:0:15857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789601604.084035:0:15857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601604.084041:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601604.084043:0:15857:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789601604.084047:0:15857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601604.084051:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601604.084052:0:15857:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789601604.084054:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789601604.084057:0:15857:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789601604.084059:0:15857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601604.084061:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601604.084062:0:15857:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789601604.084064:0:15857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789601604.084067:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601604.084068:0:15857:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789601604.084071:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789601604.084125:0:15857:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789601604.084128:0:15857:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789601604.084130:0:15857:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789601604.084134:0:15857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1789601604.084300:0:15856:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789601604.084338:0:15856:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789601604.084362:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ad1a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad1a8 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.084374:0:15856:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc29c4e00/0xf3d6e402158ad1a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad1a8 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601604.084393:0:15856:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91edf9d54800 from 1 10000000:01000000:1.0:1789601604.084396:0:15856:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789601604.084433:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5c00/0xf3d6e402158ad1bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.084450:0:15856:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc29c5c00/0xf3d6e402158ad1bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.084462:0:15856:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc29c5c00/0xf3d6e402158ad1bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601604.084489:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00660700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880577024:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789601604.084551:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601604.084594:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ecc23d1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601604.085930:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880577024 00000100:00100000:3.0:1789601604.085940:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880577024 00000100:00100000:3.0:1789601604.085992:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789601604.086001:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+17:15856:x1876532880577024:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789601604.086016:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601604.086031:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edffadda00/0xf3d6e402158ad1c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158ad1bd expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601604.086056:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edffadda00/0xf3d6e402158ad1c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158ad1bd expref: 18 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601604.086068:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edffadda00/0xf3d6e402158ad1c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ad1bd expref: 18 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601604.086077:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadda00, rc 0) 00000100:00100000:3.0:1789601604.086143:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+18:15856:x1876532880577024:12345-0@lo:101:mount.lustre.0 Request processed in 143us (1591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601604.086160:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789601604.086267:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00660700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880577024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789601604.086285:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc29c5c00/0xf3d6e402158ad1bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad1c4 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601604.086295:0:15856:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc29c5c00/0xf3d6e402158ad1bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ad1c4 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789601604.086882:0:15856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789601604.087261:0:15856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789601604.088652:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789601604.088733:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789601604.088805:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789601604.088813:0:15856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789601604.089651:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880577152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789601604.089724:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601604.089812:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8968480 going to sleep for 11 seconds 00000100:00100000:1.0:1789601604.095614:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880577152 00000100:00100000:1.0:1789601604.095629:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880577152 00000100:00100000:1.0:1789601604.095697:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789601604.095707:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+18:15856:x1876532880577152:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789601604.096023:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+18:15856:x1876532880577152:12345-0@lo:501:mount.lustre.0 Request processed in 317us (6298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601604.096031:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789601604.096691:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880577152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789601604.096744:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880577280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789601604.096798:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601604.097054:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8968480 going to sleep for 11 seconds 00000100:00100000:1.0:1789601604.097658:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880577280 00000100:00100000:1.0:1789601604.097667:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880577280 00000100:00100000:1.0:1789601604.097749:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789601604.097758:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+18:15856:x1876532880577280:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789601604.099071:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+18:15856:x1876532880577280:12345-0@lo:503:mount.lustre.0 Request processed in 1308us (2267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601604.099106:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789601604.099231:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880577280:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789601604.100366:0:15856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789601604.102429:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880577408:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601604.102750:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601604.102858:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede0714cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601604.103350:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880577408 00000100:00100000:1.0:1789601604.103359:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880577408 00000100:00100000:1.0:1789601604.103657:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789601604.103667:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+18:15856:x1876532880577408:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789601604.104003:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+18:15856:x1876532880577408:12345-0@lo:502:mount.lustre.0 Request processed in 337us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601604.104011:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789601604.104241:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880577408:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789601604.106322:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789601604.106404:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789601604.106986:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789601604.107034:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789601604.107069:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789601604.107120:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789601604.107153:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789601604.107183:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1789601604.107237:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880577536:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601604.107334:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601604.107373:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff91ede0714cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601604.107563:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880577536 00000100:00100000:0.0:1789601604.107572:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880577536 00000100:00100000:0.0:1789601604.107615:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789601604.107624:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+18:15856:x1876532880577536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789601604.109239:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+18:15856:x1876532880577536:12345-0@lo:502:mount.lustre.0 Request processed in 1609us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601604.109249:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789601604.111362:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880577536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789601604.111575:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789601604.111592:0:15856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789601604.115009:0:15861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601604.115024:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601604.115027:0:15861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789601604.115034:0:15861:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91edf9d54800 00000020:00000080:1.0:1789601604.115037:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789601604.115044:0:15861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601604.115047:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601604.115048:0:15861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789601604.115050:0:15861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601604.115053:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601604.115054:0:15861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789601604.115056:0:15861:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff91edf9d54800 00000020:00000080:1.0:1789601604.115058:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789601604.115119:0:15861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601604.115123:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601604.115124:0:15861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789601604.115126:0:15861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789601604.115128:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601604.115130:0:15861:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789601604.115133:0:15861:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91edf9d54800 00000020:00000080:1.0:1789601604.115134:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789601604.115167:0:15861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789601604.115182:0:15861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789601604.115184:0:15861:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789601604.115187:0:15861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789601604.115372:0:15856:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789601604.115399:0:15856:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789601604.115426:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc29c5c00/0xf3d6e402158ad1bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad1c4 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601604.115445:0:15856:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc29c5c00/0xf3d6e402158ad1bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad1c4 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601604.115484:0:15856:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789601604.115487:0:15856:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91edf9d54800 10000000:01000000:2.0:1789601604.115490:0:15856:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91edf9d54800 10000000:01000000:2.0:1789601604.115494:0:15856:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789601604.115500:0:15856:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91edf9d54800 from 1 10000000:01000000:2.0:1789601604.115502:0:15856:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789601604.115537:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edd8d8ce00/0xf3d6e402158ad1cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601604.115552:0:15856:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edd8d8ce00/0xf3d6e402158ad1cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601604.115564:0:15856:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edd8d8ce00/0xf3d6e402158ad1cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601604.115589:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880577664:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789601604.115665:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601604.115715:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8968240 going to sleep for 11 seconds 00000100:00100000:1.0:1789601604.115924:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880577664 00000100:00100000:1.0:1789601604.115933:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880577664 00000100:00100000:1.0:1789601604.115973:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789601604.115981:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+18:15856:x1876532880577664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789601604.115995:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601604.116007:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc29c5a00/0xf3d6e402158ad1d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158ad1cb expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.116029:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c5a00/0xf3d6e402158ad1d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158ad1cb expref: 19 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.116040:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc29c5a00/0xf3d6e402158ad1d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ad1cb expref: 19 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.116049:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c5a00, rc 0) 00000100:00100000:1.0:1789601604.116090:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:15856:x1876532880577664:12345-0@lo:101:mount.lustre.0 Request processed in 109us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601604.116096:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789601604.117035:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880577664:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789601604.117055:0:15856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edd8d8ce00/0xf3d6e402158ad1cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad1d2 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601604.117066:0:15856:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edd8d8ce00/0xf3d6e402158ad1cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ad1d2 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789601604.117905:0:15856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1789601604.126249:0:15856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789601604.127996:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789601604.128085:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789601604.128140:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789601604.128185:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789601604.128214:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789601604.128252:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789601604.128282:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789601604.128308:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789601604.128361:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789601604.128389:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789601604.128425:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789601604.130703:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789601604.130760:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789601604.130794:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789601604.134648:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789601604.134758:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789601604.134796:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789601604.134898:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789601604.134939:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789601604.134972:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789601604.135023:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789601604.135062:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789601604.135094:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789601604.135143:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789601604.135189:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789601604.135222:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789601604.135268:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789601604.135303:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789601604.135351:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789601604.135403:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1789601604.135457:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1789601604.135497:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1789601604.135534:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1789601604.135604:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1789601604.135644:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1789601604.135694:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1789601604.135730:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1789601604.135831:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1789601604.135863:0:15856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1789601604.135973:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880577792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789601604.136042:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601604.136097:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8968240 going to sleep for 11 seconds 00000100:00100000:1.0:1789601604.137940:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880577792 00000100:00100000:1.0:1789601604.137956:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880577792 00000100:00100000:1.0:1789601604.138009:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789601604.138018:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:15856:x1876532880577792:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789601604.138324:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:15856:x1876532880577792:12345-0@lo:501:mount.lustre.0 Request processed in 296us (2270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601604.138332:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789601604.145275:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880577792:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789601604.145367:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880577920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789601604.145517:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601604.145560:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880577920 00000100:00100000:3.0:1789601604.145567:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880577920 00000100:00100000:3.0:1789601604.146552:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789601604.146566:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:15856:x1876532880577920:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789601604.146879:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:15856:x1876532880577920:12345-0@lo:503:mount.lustre.0 Request processed in 315us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601604.146887:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789601604.157761:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8b76cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789601604.157831:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880577920:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789601604.166219:0:15856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789601604.166387:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880578048:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789601604.167605:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601604.167833:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8b76840 going to sleep for 11 seconds 00000100:00100000:1.0:1789601604.170391:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880578048 00000100:00100000:1.0:1789601604.170406:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880578048 00000100:00100000:1.0:1789601604.170553:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789601604.170564:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:15856:x1876532880578048:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789601604.170943:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:15856:x1876532880578048:12345-0@lo:502:mount.lustre.0 Request processed in 381us (3341us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601604.170951:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789601604.171057:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880578048:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789601604.171379:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789601604.171428:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789601604.171468:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789601604.171518:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789601604.171549:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789601604.171587:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789601604.171613:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789601604.171638:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789601604.171683:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789601604.171717:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789601604.171743:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789601604.171780:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789601604.171807:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789601604.171869:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789601604.171920:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789601604.171958:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789601604.171988:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789601604.172035:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789601604.172070:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789601604.172097:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789601604.172134:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789601604.172161:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789601604.172190:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789601604.172247:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789601604.172278:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789601604.172303:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789601604.172354:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789601604.172382:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789601604.172408:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789601604.172467:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789601604.172497:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789601604.172531:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789601604.172556:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789601604.172592:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789601604.172618:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789601604.172656:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789601604.172690:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789601604.172723:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789601604.172765:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789601604.172793:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789601604.172858:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880578176:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789601604.172929:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601604.181607:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8968cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601604.181752:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880578176 00000100:00100000:0.0:1789601604.181763:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880578176 00000100:00100000:0.0:1789601604.181827:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789601604.181862:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:15856:x1876532880578176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789601604.182137:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:15856:x1876532880578176:12345-0@lo:502:mount.lustre.0 Request processed in 301us (9206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601604.182145:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789601604.182299:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880578176:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789601604.182526:0:15856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1789601604.182543:0:15856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789601604.183768:0:15866:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789601604.183785:0:15866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff91edd174cd40) 00000020:00000080:2.0:1789601604.183806:0:15866:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1789601604.183970:0:15866:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91edf9d54800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789601604.183974:0:15866:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91edf9d54800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789601604.183977:0:15866:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91edf9d54800 3 00010000:00080000:2.0:1789601604.184017:0:15866:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91ecc18c3800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.130@tcp at head 00010000:00010000:2.0:1789601604.190569:0:15866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1789601604.190862:0:15866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789601604.190904:0:15866:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789601604.190918:0:15866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf3d6e402158ad1e0 00000100:00080000:2.0:1789601604.190928:0:15866:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789601604.190941:0:15866:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91ecc18c3800 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1789601604.190977:0:15866:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ecc2c6f480 x1876532880578304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789601604.191012:0:15866:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789601604.192280:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789601604.192286:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789601604.192289:0:38:0:(import.c:65:import_set_state_nolock()) ffff91eddccc1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789601604.192296:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 470 00000100:00080000:1.0:1789601604.192301:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1789601604.192310:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eddccc1000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:1.0:1789601604.192355:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ee00662a00 x1876532880578560/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789601604.192410:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601604.192425:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880578432:0@lo:400:kworker.0 00000100:00100000:1.0:1789601604.192711:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601604.192761:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880578816:0@lo:400:kworker.0 00000100:00100000:1.0:1789601604.192789:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601604.192808:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789601604.192813:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880578688:0@lo:400:kworker.0 00000100:00100000:1.0:1789601604.192830:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601604.192882:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880578816 00000100:00100000:1.0:1789601604.192897:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880578816 00000100:00100000:1.0:1789601604.192951:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880578688 00000100:00100000:1.0:1789601604.192954:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880578688 00000100:00100000:1.0:1789601604.192969:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789601604.192976:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880578816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601604.193029:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1876532880578816:12345-0@lo:400:kworker.0 Request processed in 54us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601604.193036:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789601604.193051:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789601604.193057:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880578688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601604.193081:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1876532880578688:12345-0@lo:400:kworker.0 Request processed in 26us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601604.193087:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789601604.193102:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789601604.193132:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ee00663b80 x1876532880578688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601604.193143:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3318:1876532880578688:0@lo:400:kworker.0 00010000:00080000:1.0:1789601604.193153:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ee00661180 x1876532880578816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601604.193161:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3318:1876532880578816:0@lo:400:kworker.0 00000100:00100000:2.0:1789601604.193575:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880578432 00000100:00100000:2.0:1789601604.193580:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880578432 00000100:00100000:2.0:1789601604.193628:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789601604.193635:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880578432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601604.193686:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880578432:12345-0@lo:400:kworker.0 Request processed in 52us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601604.193692:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789601604.193724:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880578432:0@lo:400:kworker.0 00000100:00100000:0.0:1789601604.193807:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1876532880578304:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789601604.193876:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601604.193903:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880578560:0@lo:8:kworker.0 00000100:00100000:0.0:1789601604.193929:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601604.193957:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880578560 00000100:00100000:0.0:1789601604.193962:0:15140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880578560 00000100:00100000:0.0:1789601604.193980:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789601604.193984:0:15140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3316:x1876532880578560:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789601604.194031:0:15140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3316:x1876532880578560:12345-0@lo:8:kworker.0 Request processed in 45us (100us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789601604.194048:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789601604.194072:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789601604.194078:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91eddccc1000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789601604.194082:0:3316:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789601604.194084:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880578560:0@lo:8:kworker.0 00000040:00080000:2.0:1789601604.194341:0:15866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:1.0:1789601604.194744:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601604.194758:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880578304 00000100:00100000:1.0:1789601604.194762:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880578304 00000100:00100000:1.0:1789601604.194793:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601604.194799:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3316:x1876532880578304:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789601604.194816:0:14455:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:1.0:1789601604.194878:0:14455:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf3d6e402158ad1e7 00000004:00100000:1.0:1789601604.194892:0:14455:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789601604.194920:0:14455:0:(import.c:65:import_set_state_nolock()) ffff91edffe43000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789601604.194974:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3316:x1876532880578304:12345-0@lo:38:llog_process_th.0 Request processed in 174us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601604.194983:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789601604.195018:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91ecc2c6f480 x1876532880578304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789601614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601604.195028:0:3316:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789601604.195034:0:3316:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789601604.195040:0:3316:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789601604.195045:0:3316:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789601604.195047:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91ecc18c3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789601604.195053:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3316:1876532880578304:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1789601604.195172:0:15856:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789601604.195200:0:15856:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789601604.195215:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edd8d8ce00/0xf3d6e402158ad1cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad1d2 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601604.195225:0:15856:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edd8d8ce00/0xf3d6e402158ad1cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad1d2 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789601604.195278:0:15856:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789601604.195280:0:15856:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789601604.195281:0:15856:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601604.195283:0:15856:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601604.195284:0:15856:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601604.195286:0:15856:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601604.195287:0:15856:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789601604.195288:0:15856:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601604.195290:0:15856:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789601604.195293:0:15856:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789601604.195295:0:15856:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789601604.195296:0:15856:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789601604.195298:0:15856:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789601604.195299:0:15856:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789601604.195300:0:15856:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789601604.195301:0:15856:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789601604.195302:0:15856:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789601604.195303:0:15856:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789601604.195304:0:15856:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789601604.195343:0:15856:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789601604.195361:0:15856:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880578944:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789601604.195397:0:15856:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601604.195423:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880578944 00000100:00100000:0.0:1789601604.195426:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880578944 00000100:00100000:0.0:1789601604.195525:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789601604.195532:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:15856:x1876532880578944:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789601604.195551:0:14449:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789601604.195566:0:14449:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789601604.195981:0:15856:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc51c7cc0 going to sleep for 11 seconds 20000000:01000000:1.0:1789601604.232780:0:14449:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789601604.232799:0:14449:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789601604.232926:0:14470:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789601604.232931:0:14470:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789601604.232955:0:14470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91edd8d8de00/0xf3d6e402158ad1ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601604.232976:0:14470:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ee00924400/0xf3d6e402158ad0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ad0ba expref: 19 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601604.232985:0:14470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91edd8d8de00/0xf3d6e402158ad1ee lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601604.233025:0:14470:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ee00924400/0xf3d6e402158ad0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158ad0ba expref: 19 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601604.233040:0:14470:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91ee00924400/0xf3d6e402158ad0c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158ad0ba expref: 19 pid: 14448 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601604.233054:0:14470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14470:1876532880579072:0@lo:104: 00000100:00100000:2.0:1789601604.233131:0:14470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601604.233177:0:14470:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8968cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789601604.233203:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880579072 00000100:00100000:2.0:1789601604.233211:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880579072 00000100:00100000:2.0:1789601604.233606:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789601604.233617:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+3:14470:x1876532880579072:12345-0@lo:104: 00010000:00010000:2.0:1789601604.233632:0:14437:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edffadd400/0xf3d6e402158ad0ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158ad0c1 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601604.233690:0:14437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789601604.233696:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+3:14470:x1876532880579072:12345-0@lo:104: Request processed in 83us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601604.233704:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789601604.233747:0:14470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14470:1876532880579072:0@lo:104: 00010000:00010000:2.0:1789601604.233766:0:14470:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91edd8d8de00/0xf3d6e402158ad1ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.234210:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601604.234218:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edffadd400/0xf3d6e402158ad0ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158ad0c1 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.234225:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadd400 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:1.0:1789601604.234230:0:14442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edffadd400/0xf3d6e402158ad0ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158ad0c1 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.234309:0:14442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edffadd400/0xf3d6e402158ad0ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158ad0c1 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789601604.234344:0:14442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edffadd400/0xf3d6e402158ad0ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158ad0c1 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789601604.234349:0:14442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789601604.234424:0:14442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edffadd400/0xf3d6e402158ad0ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ad0c1 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.234432:0:14442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789601604.234462:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edffadd400/0xf3d6e402158ad0ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ad0c1 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.234468:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edffadd400/0xf3d6e402158ad0ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ad0c1 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.234487:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601604.234489:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601604.234490:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601604.234503:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3319:1876532880579200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601604.234541:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601604.234594:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880579200 00000100:00100000:1.0:1789601604.234599:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880579200 00010000:00010000:1.0:1789601604.234618:0:14439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ee00924400/0xf3d6e402158ad0c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158ad0ba expref: 20 pid: 14448 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601604.234638:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601604.234645:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00663b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+20:3319:x1876532880579200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789601604.234654:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601604.234659:0:14439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ee00924400/0xf3d6e402158ad0c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158ad0ba expref: 20 pid: 14448 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.234674:0:14439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ee00924400/0xf3d6e402158ad0c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158ad0ba expref: 20 pid: 14448 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.234686:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ee00924400/0xf3d6e402158ad0c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158ad0ba expref: 20 pid: 14448 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.234697:0:14439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91edd8d8de00/0xf3d6e402158ad1ee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.234704:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edd8d8de00/0xf3d6e402158ad1ee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789601604.234716:0:14439:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008610730s 00010000:00010000:1.0:1789601604.234720:0:14439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edd8d8de00/0xf3d6e402158ad1ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.234727:0:14439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edd8d8de00/0xf3d6e402158ad1ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.234733:0:14439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91edd8d8de00/0xf3d6e402158ad1ee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.234740:0:14439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91edd8d8de00/0xf3d6e402158ad1ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.234745:0:14439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8de00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601604.234749:0:14439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91edd8d8de00/0xf3d6e402158ad1ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.234756:0:14439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91edd8d8de00/0xf3d6e402158ad1ee lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.234775:0:14439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91edd8d8de00/0xf3d6e402158ad1ee lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.234784:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601604.234812:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00663b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:3319:x1876532880579200:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601604.234820:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601604.234885:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3319:1876532880579200:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789601604.234905:0:14470:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91edd8d8de00/0xf3d6e402158ad1ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.234912:0:14470:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91edd8d8de00/0xf3d6e402158ad1ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601604.234919:0:14470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edd8d8de00/0xf3d6e402158ad1ee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601604.250082:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+18:15856:x1876532880578944:12345-0@lo:253:mount.lustre.0 Request processed in 54540us (54672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601604.250098:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789601604.252526:0:15856:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:15856:1876532880578944:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789601604.252548:0:15856:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789601604.252551:0:15856:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789601604.252553:0:15856:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789601604.252554:0:15856:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789601604.252556:0:15856:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789601604.252557:0:15856:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789601604.252559:0:15856:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789601604.252560:0:15856:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789601604.252561:0:15856:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789601604.252563:0:15856:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789601604.252605:0:15856:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789601604.259507:0:15856:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789601604.259687:0:15856:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789601604.259882:0:15856:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789601604.260039:0:15856:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789601604.260188:0:15856:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789601604.261067:0:15856:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789601604.262359:0:15856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789601604.355595:0:15856:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789601604.355603:0:15856:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789601604.355644:0:15856:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789601604.355708:0:15856:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.130@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789601604.355725:0:15856:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789601604.355755:0:15856:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1789601604.884977:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601605.581201:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880579328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789601605.581275:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601605.581364:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880579328 00000100:00100000:0.0:1789601605.581373:0:15143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880579328 00000100:00100000:0.0:1789601605.581422:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789601605.581431:0:15143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880579328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789601605.581469:0:15143:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789601605.581516:0:15143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880579328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601605.581523:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789601605.581574:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880579328:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1789601605.833466:0:14451:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789601605.833475:0:14451:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91edc5026000 from 8 10000000:01000000:2.0:1789601605.833481:0:14451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789601605.833531:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edd8d8da00/0xf3d6e402158ad1f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601605.833544:0:14451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edd8d8da00/0xf3d6e402158ad1f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601605.833556:0:14451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edd8d8da00/0xf3d6e402158ad1f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601605.833594:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880579456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789601605.833669:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601605.833728:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc9698e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601605.834329:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880579456 00000100:00100000:3.0:1789601605.834339:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880579456 00000100:00100000:3.0:1789601605.834527:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789601605.834537:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+18:14451:x1876532880579456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601605.834551:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601605.834567:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edffadd000/0xf3d6e402158ad1fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158ad1f5 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601605.834593:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edffadd000/0xf3d6e402158ad1fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158ad1f5 expref: 19 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601605.834607:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edffadd000/0xf3d6e402158ad1fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ad1f5 expref: 19 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601605.834616:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edffadd000, rc 0) 00000100:00100000:3.0:1789601605.834669:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:14451:x1876532880579456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601605.834688:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789601605.837104:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880579456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601605.837133:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edd8d8da00/0xf3d6e402158ad1f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad1fc expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601605.837145:0:14451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edd8d8da00/0xf3d6e402158ad1f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ad1fc expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601605.837237:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880579584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789601605.837335:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601605.837380:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc9698e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789601605.841560:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880579584 00000100:00100000:0.0:1789601605.841575:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880579584 00000100:00100000:0.0:1789601605.841635:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789601605.841644:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:14451:x1876532880579584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789601605.841670:0:14449:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789601605.841689:0:14449:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789601605.841692:0:14449:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789601605.841859:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:14451:x1876532880579584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 194us (4501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601605.841867:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789601605.843166:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880579584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789601605.843271:0:14451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789601605.843281:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edd8d8da00/0xf3d6e402158ad1f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad1fc expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601605.843303:0:14451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edd8d8da00/0xf3d6e402158ad1f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad1fc expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601605.898635:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601606.921293:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601607.964565:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601608.981488:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789601609.680582:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789601609.680591:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789601609.680596:0:38:0:(import.c:65:import_set_state_nolock()) ffff91eddccc1000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789601609.680627:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91eddccc1000 using connection 192.168.201.130@tcp/0@lo 00000100:00100000:2.0:1789601609.680659:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91ecc2c6f480 x1876532880579968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789601609.680770:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880579840:0@lo:400:kworker.0 00000100:00100000:2.0:1789601609.680890:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601609.680964:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789601609.680971:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3318:1876532880579712:0@lo:400:kworker.0 00000100:00100000:2.0:1789601609.681004:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601609.681029:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880580352:0@lo:400:kworker.0 00000100:00100000:2.0:1789601609.681062:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601609.681091:0:3316:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880579968:0@lo:8:kworker.0 00000100:00100000:2.0:1789601609.681116:0:3316:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601609.681150:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880579840 00000100:00100000:2.0:1789601609.681159:0:15142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880579840 00000100:00100000:2.0:1789601609.681236:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880579968 00000100:00100000:2.0:1789601609.681240:0:15142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880579968 00000100:00100000:2.0:1789601609.681257:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789601609.681268:0:15142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880579840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601609.681332:0:15142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880579840:12345-0@lo:400:kworker.0 Request processed in 66us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601609.681465:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880580096:0@lo:400:kworker.0 00000100:00100000:0.0:1789601609.681498:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601609.681523:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789601609.681530:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880580224:0@lo:400:kworker.0 00000100:00100000:0.0:1789601609.681553:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601609.681584:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880579712 00000100:00100000:0.0:1789601609.681588:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880579712 00000100:00100000:0.0:1789601609.681621:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789601609.681629:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:3318:x1876532880579712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601609.681662:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:3318:x1876532880579712:12345-0@lo:400:kworker.0 Request processed in 34us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601609.681670:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789601609.681711:0:15140:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789601609.681720:0:15140:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789601609.681739:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880580352 00000100:00100000:0.0:1789601609.681744:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880580352 00000100:00100000:0.0:1789601609.681769:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880580096 00000100:00100000:0.0:1789601609.681771:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880580096 00000100:00100000:0.0:1789601609.681782:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880580224 00000100:00100000:0.0:1789601609.681784:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880580224 00000100:00100000:0.0:1789601609.681798:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789601609.681804:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880580352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601609.681855:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880580352:12345-0@lo:400:kworker.0 Request processed in 51us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601609.681862:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789601609.681890:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789601609.681896:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880580096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601609.681930:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880580096:12345-0@lo:400:kworker.0 Request processed in 35us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601609.681937:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789601609.681948:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789601609.681954:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880580224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601609.681981:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880580224:12345-0@lo:400:kworker.0 Request processed in 28us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601609.681988:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789601609.682137:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ecc2c6d880 x1876532880580224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601609.682153:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880580224:0@lo:400:kworker.0 00010000:00080000:0.0:1789601609.682166:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ecc2c6f100 x1876532880580096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601609.682175:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880580096:0@lo:400:kworker.0 00000100:00100000:0.0:1789601609.682236:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789601609.682243:0:15140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3316:x1876532880579968:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789601609.682274:0:15140:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1789601609.682316:0:15140:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf3d6e402158ad203 00002000:00100000:0.0:1789601609.682346:0:15140:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91ee00541800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789601609.682352:0:15140:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789601609.682355:0:15140:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789601609.682797:0:15140:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789601609.682868:0:15140:0:(import.c:65:import_set_state_nolock()) ffff91ee00546800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601609.682938:0:15140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3316:x1876532880579968:12345-0@lo:8:kworker.0 Request processed in 693us (1819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601609.682946:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789601609.682988:0:3316:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ecc2c6f480 x1876532880579968/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789601634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789601609.683004:0:3316:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789601609.683013:0:3316:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789601609.683020:0:3316:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789601609.683023:0:3316:0:(import.c:65:import_set_state_nolock()) ffff91eddccc1000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789601609.683041:0:3316:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789601609.683047:0:3316:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3316:1876532880579968:0@lo:8:kworker.0 00000004:00080000:0.0:1789601609.683109:0:14479:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1789601609.683130:0:14479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14479:1876532880580608:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789601609.683165:0:14479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601609.683185:0:14479:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc9698240 going to sleep for 11 seconds 00000004:00080000:0.0:1789601609.683206:0:14478:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1789601609.684473:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789601609.684509:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880580608 00000100:00100000:2.0:1789601609.684520:0:15142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880580608 00000100:00100000:2.0:1789601609.684567:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789601609.684577:0:15142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14479:x1876532880580608:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789601609.686805:0:14478:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 479724964130ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789601609.686873:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601609.686904:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880580480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601609.687002:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601609.687206:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880580480 00000100:00100000:0.0:1789601609.689275:0:15143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880580480 00000100:00100000:0.0:1789601609.689371:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789601609.689383:0:15143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1876532880580480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789601609.689432:0:15143:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789601609.689540:0:15143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2ed2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1876532880580480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (2538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601609.689558:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789601609.689702:0:3317:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ecc2ed3b80 x1876532880580480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789601625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789601609.689729:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880580480:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789601609.693503:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789601609.693523:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789601609.693527:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789601609.693593:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3318:1876532880579712:0@lo:400:kworker.0 00010000:00080000:2.0:1789601609.693619:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ecc2c6d500 x1876532880580352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601609.693634:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880580352:0@lo:400:kworker.0 00000100:00100000:2.0:1789601609.693651:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880579840:0@lo:400:kworker.0 00002000:00080000:2.0:1789601609.694344:0:15142:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789601609.694354:0:15142:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789601609.694361:0:15142:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:2.0:1789601609.709161:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789601609.709179:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158ad20a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.709202:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1789601609.709208:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601609.709226:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158ad20a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.709248:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158ad20a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.709259:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158ad20a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.709267:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158ad20a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.709297:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789601609.709905:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601609.709915:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158ad20a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.709926:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c400 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601609.709931:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158ad20a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.709940:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158ad20a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.709966:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158ad20a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.709973:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fb9b826/0xf3d6e402158ad20a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.709996:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.709998:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.710000:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.712978:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.712997:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad211 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.713034:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.713039:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.713048:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad211 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.713829:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad211 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.713870:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad211 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.713879:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad211 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.713907:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601609.715391:0:15467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601609.715403:0:15467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad211 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.715416:0:15467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadd200 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601609.715422:0:15467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad211 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.715433:0:15467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad211 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.715458:0:15467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad211 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.715466:0:15467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad211 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.715495:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601609.715497:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601609.715499:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.716532:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.716542:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad218 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.716557:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.716562:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.716568:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad218 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.716582:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad218 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.716601:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad218 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.716609:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad218 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.716630:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789601609.716645:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601609.716650:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad218 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.716658:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadcc00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601609.716662:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad218 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.716671:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad218 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.716685:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad218 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.716692:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad218 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.716709:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.716715:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.716717:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.717410:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.717418:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad21f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.717428:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.717432:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.717437:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad21f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.717447:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad21f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.717455:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad21f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.717463:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad21f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.717485:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601609.721501:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601609.721521:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad21f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.721540:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffaddc00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601609.721561:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad21f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.721575:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad21f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.721606:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad21f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.721615:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad21f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.721642:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601609.721645:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601609.721647:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.725565:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.725584:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad226 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.725606:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.725611:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.725619:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad226 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.725646:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad226 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.725659:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad226 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.725668:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad226 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.726739:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789601609.728241:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.728255:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad22d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.728276:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.728281:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.728299:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad22d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.728317:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad22d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.728328:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad22d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.728360:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad22d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.728824:0:15467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789601609.728849:0:15467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad226 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.728859:0:15467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadca00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601609.728865:0:15467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad226 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.728875:0:15467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad226 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.728898:0:15467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad226 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.728996:0:15467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad226 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.729051:0:15467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601609.729055:0:15467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad22d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.729062:0:15467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadd600 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601609.729065:0:15467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad22d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.729074:0:15467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad22d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.729086:0:15467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad22d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.729437:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601609.729440:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601609.729442:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.732946:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789601609.732966:0:15142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad22d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789601609.733743:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.734515:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad234 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.734537:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.734544:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.734552:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad234 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.734571:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad234 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.734583:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad234 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.734592:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad234 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601609.735685:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601609.735700:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad234 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601609.735713:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadcc00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601609.735719:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad234 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601609.735731:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad234 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.736331:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789601609.736994:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad234 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601609.737011:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037de6771/0xf3d6e402158ad234 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601609.737044:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601609.737047:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.737478:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.737486:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad23b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.737501:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.737506:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.737513:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad23b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.737528:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad23b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.737540:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad23b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.737548:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad23b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601609.737833:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789601609.737851:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad23b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601609.737861:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc800 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601609.737865:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad23b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601609.737877:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad23b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601609.737895:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad23b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601609.737904:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601609.737905:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789601609.737907:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601609.737983:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.738175:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789601609.738181:0:15142:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad23b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789601609.738997:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.739006:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad242 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.739026:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.739030:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.739036:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad242 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.739050:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad242 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.739060:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad242 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.739082:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad242 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.739103:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789601609.739117:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601609.739123:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad242 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.739132:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadce00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601609.739137:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad242 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.739146:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad242 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.739172:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad242 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.739180:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad242 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.739200:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.739202:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.739204:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.739965:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.739972:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ad249 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.739984:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.739988:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.739994:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ad249 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.740006:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ad249 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.740016:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ad249 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.740024:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ad249 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.740054:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789601609.740691:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.740698:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad250 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.740708:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.740711:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.740716:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad250 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.740727:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad250 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.740737:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad250 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.740819:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad250 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.740867:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789601609.740886:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789601609.740893:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ad249 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.740902:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc200 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601609.740914:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ad249 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.740924:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ad249 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.740941:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ad249 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.740948:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac81c89b/0xf3d6e402158ad249 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.740971:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601609.740975:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad250 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.740982:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffaddc00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601609.740985:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad250 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.740992:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad250 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.741003:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad250 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.741009:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3443d51/0xf3d6e402158ad250 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.741031:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.741033:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.741035:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601609.741049:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.741988:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.741996:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad257 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.742009:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.742013:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.742018:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad257 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.742030:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad257 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.742039:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad257 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.742046:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad257 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.742175:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789601609.742189:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601609.742194:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad257 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.742224:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadd200 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601609.742229:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad257 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.742238:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad257 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.742251:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad257 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.742258:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049e27829/0xf3d6e402158ad257 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.742278:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.742280:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.742282:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.742795:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.742802:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d4e9e3c/0xf3d6e402158ad25e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.742815:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.742819:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.742824:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d4e9e3c/0xf3d6e402158ad25e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.742862:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d4e9e3c/0xf3d6e402158ad25e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.742879:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d4e9e3c/0xf3d6e402158ad25e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.742887:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d4e9e3c/0xf3d6e402158ad25e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.742914:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789601609.743354:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.743360:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000728419e6/0xf3d6e402158ad265 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.743370:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.743373:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.743378:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000728419e6/0xf3d6e402158ad265 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.743388:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000728419e6/0xf3d6e402158ad265 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.743396:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000728419e6/0xf3d6e402158ad265 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.743399:0:15467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601609.743403:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000728419e6/0xf3d6e402158ad265 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.743408:0:15467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d4e9e3c/0xf3d6e402158ad25e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.743418:0:15467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadd400 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601609.743428:0:15467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d4e9e3c/0xf3d6e402158ad25e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.743430:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601609.743437:0:15467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d4e9e3c/0xf3d6e402158ad25e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.743439:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601609.743444:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000728419e6/0xf3d6e402158ad265 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.743450:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee02167e00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601609.743452:0:15467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d4e9e3c/0xf3d6e402158ad25e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.743453:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000728419e6/0xf3d6e402158ad265 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.743461:0:15467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d4e9e3c/0xf3d6e402158ad25e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.743462:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000728419e6/0xf3d6e402158ad265 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.743472:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000728419e6/0xf3d6e402158ad265 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.743477:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000728419e6/0xf3d6e402158ad265 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.743482:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601609.743483:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601609.743485:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.743490:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.743492:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.743493:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.743868:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.743873:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fe2bc1c/0xf3d6e402158ad26c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.743881:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.743889:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.743893:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fe2bc1c/0xf3d6e402158ad26c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.743902:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fe2bc1c/0xf3d6e402158ad26c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.743910:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fe2bc1c/0xf3d6e402158ad26c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.743917:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fe2bc1c/0xf3d6e402158ad26c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.743936:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789601609.744372:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.744378:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000964497f6/0xf3d6e402158ad273 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.744387:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.744391:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.744394:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000964497f6/0xf3d6e402158ad273 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.744403:0:15467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601609.744404:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000964497f6/0xf3d6e402158ad273 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.744410:0:15467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fe2bc1c/0xf3d6e402158ad26c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.744413:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000964497f6/0xf3d6e402158ad273 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.744418:0:15467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee02166200 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601609.744422:0:15467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fe2bc1c/0xf3d6e402158ad26c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.744426:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000964497f6/0xf3d6e402158ad273 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.744430:0:15467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fe2bc1c/0xf3d6e402158ad26c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.744442:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601609.744442:0:15467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fe2bc1c/0xf3d6e402158ad26c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.744450:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601609.744454:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000964497f6/0xf3d6e402158ad273 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.744456:0:15467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fe2bc1c/0xf3d6e402158ad26c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.744462:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee02167c00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601609.744465:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000964497f6/0xf3d6e402158ad273 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.744473:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000964497f6/0xf3d6e402158ad273 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.744476:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601609.744477:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601609.744479:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.744484:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000964497f6/0xf3d6e402158ad273 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.744491:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000964497f6/0xf3d6e402158ad273 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.744503:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.744504:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.744505:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.744900:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.744913:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba06026e/0xf3d6e402158ad27a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.744922:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.744925:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.744929:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba06026e/0xf3d6e402158ad27a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.744939:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba06026e/0xf3d6e402158ad27a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.744948:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba06026e/0xf3d6e402158ad27a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.744954:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba06026e/0xf3d6e402158ad27a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.744974:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789601609.746014:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601609.746019:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601609.746026:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba06026e/0xf3d6e402158ad27a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601609.746049:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee02166400 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601609.746054:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba06026e/0xf3d6e402158ad27a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601609.746076:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba06026e/0xf3d6e402158ad27a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601609.746095:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba06026e/0xf3d6e402158ad27a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601609.746102:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba06026e/0xf3d6e402158ad27a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601609.746126:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601609.746128:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601609.746129:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.746725:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.746736:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d982f62e/0xf3d6e402158ad281 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.746831:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.746864:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.746872:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d982f62e/0xf3d6e402158ad281 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.746887:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d982f62e/0xf3d6e402158ad281 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.746905:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d982f62e/0xf3d6e402158ad281 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.746914:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d982f62e/0xf3d6e402158ad281 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.746939:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601609.747049:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601609.747057:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d982f62e/0xf3d6e402158ad281 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.747066:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee02167400 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601609.747070:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d982f62e/0xf3d6e402158ad281 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.747079:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d982f62e/0xf3d6e402158ad281 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.747091:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d982f62e/0xf3d6e402158ad281 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.747098:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d982f62e/0xf3d6e402158ad281 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.747115:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601609.747117:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601609.747125:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.747681:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.747690:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad288 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.747989:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.747993:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.747999:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad288 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.748012:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad288 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.748020:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad288 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.748028:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad288 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.748138:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789601609.751466:0:15467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601609.751485:0:15467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad288 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601609.751501:0:15467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadca00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601609.751507:0:15467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad288 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601609.751520:0:15467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad288 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601609.751554:0:15467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad288 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601609.751561:0:15467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014fc9751/0xf3d6e402158ad288 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601609.751590:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601609.751592:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601609.751594:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.752583:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.752595:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad28f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.752612:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.752617:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.752625:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad28f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.752641:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad28f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.752653:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad28f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.752661:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad28f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.752685:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789601609.752700:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601609.752707:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad28f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.752715:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadce00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601609.752728:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad28f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.752739:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad28f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.752765:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad28f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.752773:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e0a19de/0xf3d6e402158ad28f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.752795:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.752797:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.752799:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.753958:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.753970:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad296 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.753988:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.753993:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.753998:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad296 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.754014:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad296 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.754024:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad296 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.754038:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad296 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.754075:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601609.754095:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601609.754104:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad296 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.754113:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc800 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601609.754117:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad296 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.754128:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad296 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.754144:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad296 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.754151:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000279d7ac4/0xf3d6e402158ad296 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.754174:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601609.754176:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601609.754178:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.754816:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.754824:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad29d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.754861:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.754866:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.754871:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad29d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.754883:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad29d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.754891:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad29d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.754898:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad29d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.754923:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789601609.754934:0:15467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601609.754939:0:15467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad29d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.754954:0:15467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadd600 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601609.754958:0:15467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad29d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.754967:0:15467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad29d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.754979:0:15467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad29d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.754987:0:15467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac72d774/0xf3d6e402158ad29d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.755007:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.755008:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.755010:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.755451:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.755457:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1333ae5/0xf3d6e402158ad2a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.755466:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.755470:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.755474:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1333ae5/0xf3d6e402158ad2a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.755484:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1333ae5/0xf3d6e402158ad2a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.755499:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1333ae5/0xf3d6e402158ad2a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.755509:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1333ae5/0xf3d6e402158ad2a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.755525:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789601609.755535:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601609.755540:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1333ae5/0xf3d6e402158ad2a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.755548:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89400 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601609.755551:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1333ae5/0xf3d6e402158ad2a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.755558:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1333ae5/0xf3d6e402158ad2a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.755570:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1333ae5/0xf3d6e402158ad2a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.755579:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1333ae5/0xf3d6e402158ad2a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.755593:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.755600:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.755602:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.756039:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.756047:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001469acd/0xf3d6e402158ad2ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.756056:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.756059:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.756064:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001469acd/0xf3d6e402158ad2ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.756073:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001469acd/0xf3d6e402158ad2ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.756080:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001469acd/0xf3d6e402158ad2ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.756087:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001469acd/0xf3d6e402158ad2ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.756109:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601609.756119:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601609.756126:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001469acd/0xf3d6e402158ad2ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.756134:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89600 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601609.756138:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001469acd/0xf3d6e402158ad2ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.756157:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001469acd/0xf3d6e402158ad2ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.756169:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001469acd/0xf3d6e402158ad2ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.756177:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001469acd/0xf3d6e402158ad2ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.756192:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601609.756194:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601609.756195:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.756501:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.756507:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000651ada8/0xf3d6e402158ad2b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.756515:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.756518:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.756522:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000651ada8/0xf3d6e402158ad2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.756538:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000651ada8/0xf3d6e402158ad2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.756547:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000651ada8/0xf3d6e402158ad2b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.756556:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000651ada8/0xf3d6e402158ad2b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.756573:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789601609.756583:0:15467:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601609.756588:0:15467:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000651ada8/0xf3d6e402158ad2b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.756596:0:15467:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88200 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601609.756599:0:15467:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000651ada8/0xf3d6e402158ad2b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.756608:0:15467:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000651ada8/0xf3d6e402158ad2b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.756619:0:15467:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000651ada8/0xf3d6e402158ad2b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.756627:0:15467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000651ada8/0xf3d6e402158ad2b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.756646:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.756647:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.756650:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.757074:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.757079:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046912a8b/0xf3d6e402158ad2b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.757089:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.757092:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.757096:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046912a8b/0xf3d6e402158ad2b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.757105:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046912a8b/0xf3d6e402158ad2b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.757113:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046912a8b/0xf3d6e402158ad2b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.757120:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046912a8b/0xf3d6e402158ad2b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.757136:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789601609.757144:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789601609.757148:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046912a8b/0xf3d6e402158ad2b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.757166:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89800 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:3.0:1789601609.757170:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046912a8b/0xf3d6e402158ad2b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.757178:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046912a8b/0xf3d6e402158ad2b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.757189:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046912a8b/0xf3d6e402158ad2b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.757196:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046912a8b/0xf3d6e402158ad2b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.757209:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.757210:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601609.757825:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789601609.758597:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789601609.758608:0:15142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cea1ae1/0xf3d6e402158ad2c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.758625:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789601609.758630:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601609.758635:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cea1ae1/0xf3d6e402158ad2c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.758648:0:15142:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cea1ae1/0xf3d6e402158ad2c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.758666:0:15142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cea1ae1/0xf3d6e402158ad2c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.758675:0:15142:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008cea1ae1/0xf3d6e402158ad2c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601609.758704:0:15142:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789601609.758717:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601609.758726:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008cea1ae1/0xf3d6e402158ad2c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.758735:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88400 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601609.758740:0:14442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008cea1ae1/0xf3d6e402158ad2c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.758750:0:14442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008cea1ae1/0xf3d6e402158ad2c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.758765:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008cea1ae1/0xf3d6e402158ad2c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.758785:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cea1ae1/0xf3d6e402158ad2c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601609.758803:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601609.758805:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601609.758807:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789601609.759256:0:15142:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1789601609.760019:0:15142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14479:x1876532880580608:12345-0@lo:5:osp-pre-1-0.0 Request processed in 75435us (76844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601609.760038:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:2.0:1789601609.763168:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789601609.764970:0:14479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14479:1876532880580608:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789601609.765008:0:14479:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789601609.765313:0:14479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14479:1876532880580736:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789601609.765403:0:14479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601609.765485:0:14479:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd012af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789601609.765510:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880580736 00000100:00100000:2.0:1789601609.765519:0:15140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880580736 00000100:00100000:2.0:1789601609.765592:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789601609.765602:0:15140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14479:x1876532880580736:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789601609.765662:0:15140:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1789601609.778263:0:15140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14479:x1876532880580736:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12647us (12846us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789601609.778289:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789601609.778565:0:14479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14479:1876532880580736:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789601609.778587:0:14479:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1789601609.993810:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601610.697618:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789601610.697656:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880580864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601610.697754:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601610.697866:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880580864 00000100:00100000:1.0:1789601610.697882:0:15143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880580864 00000100:00100000:1.0:1789601610.697942:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789601610.697951:0:15143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880580864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601610.697999:0:15143:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601610.698049:0:15143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880580864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601610.698057:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789601610.698112:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00661180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880580864:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789601611.017165:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789601612.043422:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789601612.077628:0:16213:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg130-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1789601612.881510:0:14486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789601613.066008:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601614.089606:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789601614.651296:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601614.651466:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858561920 00000100:00100000:3.0:1789601614.651481:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858561920 00000100:00100000:3.0:1789601614.651553:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:3.0:1789601614.651564:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2355:x1876532858561920:12345-192.168.201.30@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789601614.651604:0:14448:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 15f5cf11-52eb-460f-b02c-b9251b294d39@192.168.201.30@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:3.0:1789601614.651651:0:14448:0:(genops.c:1384:class_connect()) connect: client 15f5cf11-52eb-460f-b02c-b9251b294d39, cookie 0xf3d6e402158ad2c7 00000100:00080000:3.0:1789601614.651967:0:14448:0:(import.c:65:import_set_state_nolock()) ffff91ecc18cc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789601614.652075:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+5:2355:x1876532858561920:12345-192.168.201.30@tcp:250:mount.lustre.0 Request processed in 509us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601614.652085:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 76 00000100:00100000:3.0:1789601614.655399:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601614.655518:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858562048 00000100:00100000:1.0:1789601614.655532:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858562048 00000100:00100000:1.0:1789601614.655610:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:1.0:1789601614.655622:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+5:13756:x1876532858562048:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789601614.655644:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601614.655668:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc29c4200/0xf3d6e402158ad2ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f50613e6 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601614.655708:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c4200/0xf3d6e402158ad2ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613e6 expref: 6 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601614.655740:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc29c4200/0xf3d6e402158ad2ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613e6 expref: 6 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601614.655751:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c4200, rc 0) 00000100:00100000:1.0:1789601614.655969:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+6:13756:x1876532858562048:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 348us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601614.655978:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 77 00000100:00100000:2.0:1789601614.674262:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601614.674412:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858562176 00000100:00100000:1.0:1789601614.674429:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858562176 00000100:00100000:1.0:1789601614.674507:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:1.0:1789601614.674519:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+6:13756:x1876532858562176:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789601614.674920:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+6:13756:x1876532858562176:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 403us (682us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789601614.674930:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 78 00000100:00100000:3.0:1789601614.679652:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601614.679702:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858562304 00000100:00100000:3.0:1789601614.679714:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858562304 00000100:00100000:3.0:1789601614.679772:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:3.0:1789601614.679781:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee0025c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+6:13756:x1876532858562304:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789601614.679801:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601614.679824:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc3b88200/0xf3d6e402158ad2d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f50613ed expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601614.679870:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc3b88200/0xf3d6e402158ad2d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613ed expref: 7 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601614.679878:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc3b88200/0xf3d6e402158ad2d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50613ed expref: 7 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601614.679886:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88200, rc 0) 00000100:00100000:3.0:1789601614.679939:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee0025c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+7:13756:x1876532858562304:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 161us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601614.679945:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 79 00000100:00100000:1.0:1789601614.683456:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601614.683605:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858562432 00000100:00100000:2.0:1789601614.683617:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858562432 00000100:00100000:2.0:1789601614.683705:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:2.0:1789601614.683717:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+7:13756:x1876532858562432:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789601614.684211:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aa8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+8:13756:x1876532858562432:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 493us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601614.684232:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 80 00000100:00100000:0.0:1789601614.699817:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601614.700703:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858562560 00000100:00100000:1.0:1789601614.700719:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858562560 00000100:00100000:2.0:1789601614.701546:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:2.0:1789601614.701566:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+8:13756:x1876532858562560:12345-192.168.201.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789601614.701958:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aaa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+8:13756:x1876532858562560:12345-192.168.201.30@tcp:503:mount.lustre.0 Request processed in 397us (2157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601614.701968:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 81 00000100:00100000:1.0:1789601614.708230:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601614.708581:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858562688 00000100:00100000:2.0:1789601614.708597:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858562688 00000100:00100000:2.0:1789601614.708668:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:2.0:1789601614.708680:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+8:13774:x1876532858562688:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789601614.709761:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aa9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+8:13774:x1876532858562688:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 1076us (1540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601614.709772:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 82 00000100:00100000:1.0:1789601614.729549:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601614.731432:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858562816 00000100:00100000:2.0:1789601614.731454:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858562816 00000100:00100000:2.0:1789601614.731556:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 83 00000100:00100000:2.0:1789601614.731569:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+8:13774:x1876532858562816:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789601614.732012:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+8:13774:x1876532858562816:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 445us (2489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601614.732020:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 83 00000100:00100000:0.0:1789601614.735515:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601614.735888:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858562944 00000100:00100000:2.0:1789601614.735903:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858562944 00000100:00100000:2.0:1789601614.735988:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:2.0:1789601614.736001:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+8:13756:x1876532858562944:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789601614.736046:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601614.736074:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edd8d8d000/0xf3d6e402158ad2dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061417 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601614.736412:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edd8d8d000/0xf3d6e402158ad2dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061417 expref: 9 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601614.736427:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edd8d8d000/0xf3d6e402158ad2dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061417 expref: 9 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601614.736439:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8d000, rc 0) 00000100:00100000:2.0:1789601614.736520:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aa9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+9:13756:x1876532858562944:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 523us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601614.736528:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 84 00000100:00100000:1.0:1789601614.746664:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601614.746854:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858563072 00000100:00100000:3.0:1789601614.746869:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858563072 00000100:00100000:3.0:1789601614.747004:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 85 00000100:00100000:3.0:1789601614.747017:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+9:13756:x1876532858563072:12345-192.168.201.30@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789601614.747073:0:14448:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789601614.747094:0:14448:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789601614.747099:0:14448:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789601614.747113:0:14448:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789601614.747116:0:14448:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789601614.749104:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aaa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+9:13756:x1876532858563072:12345-192.168.201.30@tcp:256:mount.lustre.0 Request processed in 2076us (4698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601614.749135:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 85 00000100:00100000:0.0:1789601614.755300:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601614.755964:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858563200 00000100:00100000:1.0:1789601614.755979:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858563200 00000100:00100000:1.0:1789601614.756052:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:1.0:1789601614.756064:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+9:13756:x1876532858563200:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789601614.756086:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601614.756149:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc29c4800/0xf3d6e402158ad2e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f506141e expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601614.756190:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c4800/0xf3d6e402158ad2e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506141e expref: 10 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601614.756213:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc29c4800/0xf3d6e402158ad2e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506141e expref: 10 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601614.756223:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c4800, rc 0) 00000100:00100000:1.0:1789601614.756689:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+10:13756:x1876532858563200:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 624us (1401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601614.756698:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 86 00000100:00100000:1.0:1789601614.758700:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601614.758811:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858563328 00000100:00100000:0.0:1789601614.758823:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858563328 00000100:00100000:0.0:1789601614.758943:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 87 00000100:00100000:0.0:1789601614.758953:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+10:13756:x1876532858563328:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789601614.759580:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aaac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+10:13756:x1876532858563328:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 618us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601614.759590:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 87 00000100:00100000:3.0:1789601614.761695:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601614.761774:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858563456 00000100:00100000:1.0:1789601614.761783:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858563456 00000100:00100000:1.0:1789601614.761872:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 88 00000100:00100000:1.0:1789601614.761881:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+10:13756:x1876532858563456:12345-192.168.201.30@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789601614.762635:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aa8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+10:13756:x1876532858563456:12345-192.168.201.30@tcp:503:mount.lustre.0 Request processed in 751us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601614.762645:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 88 00000100:00100000:1.0:1789601614.764923:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601614.765189:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858563584 00000100:00100000:0.0:1789601614.765228:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858563584 00000100:00100000:0.0:1789601614.765359:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 89 00000100:00100000:0.0:1789601614.765372:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+10:13781:x1876532858563584:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789601614.765683:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+10:13781:x1876532858563584:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 314us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601614.765692:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 89 00000100:00100000:3.0:1789601614.774724:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601614.774901:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858563712 00000100:00100000:1.0:1789601614.774915:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858563712 00000100:00100000:1.0:1789601614.774992:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 90 00000100:00100000:1.0:1789601614.775005:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+10:13781:x1876532858563712:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789601614.775569:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+10:13781:x1876532858563712:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 565us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601614.775586:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 90 00000100:00100000:1.0:1789601614.790403:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601614.790518:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858563840 00000100:00100000:0.0:1789601614.790532:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858563840 00000100:00100000:0.0:1789601614.790591:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:0.0:1789601614.790603:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1876532858563840:12345-192.168.201.30@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789601614.790646:0:14456:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 9e82277c-40aa-4559-8a65-5f21a02d7d72@192.168.201.30@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:0.0:1789601614.790715:0:14456:0:(genops.c:1384:class_connect()) connect: client 9e82277c-40aa-4559-8a65-5f21a02d7d72, cookie 0xf3d6e402158ad2ea 00000004:00100000:0.0:1789601614.790755:0:14456:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1789601614.790762:0:14456:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1789601614.793298:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601614.793332:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3319:1876532880580992:0@lo:400:kworker.0 00000100:00100000:1.0:1789601614.793442:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601614.793566:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880581376:0@lo:400:kworker.0 00000100:00100000:1.0:1789601614.793597:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601614.793654:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789601614.793660:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880581504:0@lo:400:kworker.0 00000100:00100000:1.0:1789601614.793685:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601614.793930:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880581248:0@lo:400:kworker.0 00000100:00100000:2.0:1789601614.793970:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601614.794008:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789601614.794013:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880581120:0@lo:400:kworker.0 00000100:00100000:2.0:1789601614.794035:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601614.794051:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880581632:0@lo:400:kworker.0 00000100:00100000:2.0:1789601614.794072:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601614.794101:0:14455:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789601614.794112:0:14455:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789601614.794269:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880581376 00000100:00100000:2.0:1789601614.794277:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880581376 00000100:00100000:2.0:1789601614.794324:0:14455:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789601614.794331:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880581504 00000100:00100000:2.0:1789601614.794334:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880581504 00000100:00100000:2.0:1789601614.794378:0:14455:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789601614.794383:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880581632 00000100:00100000:2.0:1789601614.794386:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880581632 00000100:00100000:2.0:1789601614.794401:0:14455:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789601614.794409:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789601614.794418:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880581376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601614.794483:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1876532880581376:12345-0@lo:400:kworker.0 Request processed in 66us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601614.794492:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789601614.794509:0:14455:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789601614.794515:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789601614.794520:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880581504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601614.794928:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1876532880581504:12345-0@lo:400:kworker.0 Request processed in 405us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601614.794936:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789601614.794948:0:14455:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789601614.794954:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789601614.794968:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880581632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601614.795014:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1876532880581632:12345-0@lo:400:kworker.0 Request processed in 54us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601614.795024:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1789601614.795049:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789601614.795092:0:3318:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00660000 x1876532880581632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789601614.795108:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3318:1876532880581632:0@lo:400:kworker.0 00000100:00100000:1.0:1789601614.795508:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880581248 00000100:00100000:1.0:1789601614.795514:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880581248 00000100:00100000:1.0:1789601614.795571:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880581120 00000100:00100000:1.0:1789601614.795574:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880581120 00000100:00100000:1.0:1789601614.795596:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601614.795604:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3318:x1876532880581248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601614.795652:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3318:x1876532880581248:12345-0@lo:400:kworker.0 Request processed in 49us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601614.795659:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789601614.795678:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601614.795684:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880581120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601614.795723:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880581120:12345-0@lo:400:kworker.0 Request processed in 40us (1687us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601614.795729:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789601614.795766:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880581120:0@lo:400:kworker.0 00000100:00100000:1.0:1789601614.795790:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00661500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880581248:0@lo:400:kworker.0 00010000:00080000:1.0:1789601614.795824:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00662a00 x1876532880581504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601614.795864:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3319:1876532880581504:0@lo:400:kworker.0 00010000:00080000:1.0:1789601614.795878:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91ee00662680 x1876532880581376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789601630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789601614.795887:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00662680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3319:1876532880581376:0@lo:400:kworker.0 00000100:00100000:0.0:1789601614.796512:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880580992 00000100:00100000:0.0:1789601614.796519:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880580992 00000100:00100000:0.0:1789601614.796549:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789601614.796557:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:3319:x1876532880580992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601614.796615:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aa9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:3319:x1876532880580992:12345-0@lo:400:kworker.0 Request processed in 59us (3173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601614.796622:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789601614.796666:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3319:1876532880580992:0@lo:400:kworker.0 00000100:00080000:2.0:1789601614.797941:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789601614.797950:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789601614.798711:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601614.798739:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880581760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601614.798865:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601614.798942:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880581760 00000100:00100000:0.0:1789601614.798955:0:15143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880581760 00000100:00100000:0.0:1789601614.799011:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789601614.799019:0:15143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1876532880581760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789601614.799060:0:15143:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789601614.799105:0:15143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3317:x1876532880581760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601614.799113:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789601614.800941:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2c6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880581760:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789601614.839497:0:14456:0:(import.c:65:import_set_state_nolock()) ffff91ee00540000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601614.839680:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:2355:x1876532858563840:12345-192.168.201.30@tcp:38:mount.lustre.0 Request processed in 49076us (49291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601614.839692:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:2.0:1789601614.844296:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601614.844354:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601614.844390:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858564096 00000100:00100000:2.0:1789601614.844403:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858564096 00000100:00100000:3.0:1789601614.844423:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858563968 00000100:00100000:3.0:1789601614.844428:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858563968 00000100:00100000:3.0:1789601614.844481:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:3.0:1789601614.844494:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+7:0:x1876532858563968:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789601614.844555:0:14455:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789601614.844591:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:2.0:1789601614.844600:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+7:13756:x1876532858564096:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789601614.844616:0:16328:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789601614.844669:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+7:0:x1876532858563968:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 177us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601614.844678:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:2.0:1789601614.846334:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:13756:x1876532858564096:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 1721us (2042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601614.846349:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00080000:2.0:1789601614.846396:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601614.848286:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601614.849061:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858564224 00000100:00100000:1.0:1789601614.849081:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858564224 00000100:00100000:1.0:1789601614.849182:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1789601614.849205:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:13756:x1876532858564224:12345-192.168.201.30@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789601614.849321:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:13756:x1876532858564224:12345-192.168.201.30@tcp:40:mount.lustre.0 Request processed in 129us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601614.849329:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:3.0:1789601614.855019:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601614.855060:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601614.855102:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601614.855742:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858564608 00000100:00100000:3.0:1789601614.855757:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858564608 00000100:00100000:0.0:1789601614.855811:0:16106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858564352 00000100:00100000:3.0:1789601614.855815:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:0.0:1789601614.855816:0:16106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858564352 00000100:00100000:3.0:1789601614.855827:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:13756:x1876532858564608:12345-192.168.201.30@tcp:33:mount.lustre.0 00000100:00100000:0.0:1789601614.855854:0:16106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858564480 00000100:00100000:0.0:1789601614.855857:0:16106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858564480 00000100:00100000:0.0:1789601614.855876:0:16106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:0.0:1789601614.855882:0:16106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2355:x1876532858564352:12345-192.168.201.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789601614.855922:0:16106:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 9e82277c-40aa-4559-8a65-5f21a02d7d72@192.168.201.30@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:0.0:1789601614.855980:0:16106:0:(genops.c:1384:class_connect()) connect: client 9e82277c-40aa-4559-8a65-5f21a02d7d72, cookie 0xf3d6e402158ad2f1 00002000:00100000:0.0:1789601614.855994:0:16106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9e82277c-40aa-4559-8a65-5f21a02d7d72/ffff91edffa52800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789601614.856025:0:16106:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789601614.856066:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:1.0:1789601614.856073:0:15142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1876532858564480:12345-192.168.201.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789601614.856089:0:15142:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 9e82277c-40aa-4559-8a65-5f21a02d7d72@192.168.201.30@tcp t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:1.0:1789601614.856108:0:15142:0:(genops.c:1384:class_connect()) connect: client 9e82277c-40aa-4559-8a65-5f21a02d7d72, cookie 0xf3d6e402158ad2f8 00002000:00100000:1.0:1789601614.856113:0:15142:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9e82277c-40aa-4559-8a65-5f21a02d7d72/ffff91edffe44000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789601614.856121:0:15142:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789601614.857155:0:15142:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:0.0:1789601614.857168:0:16106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789601614.857424:0:15142:0:(import.c:65:import_set_state_nolock()) ffff91edffe41800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789601614.857589:0:15142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:2355:x1876532858564480:12345-192.168.201.30@tcp:8:mount.lustre.0 Request processed in 1512us (2526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601614.857600:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00080000:0.0:1789601614.857639:0:16106:0:(import.c:65:import_set_state_nolock()) ffff91edffa54000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601614.857676:0:16106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:2355:x1876532858564352:12345-192.168.201.30@tcp:8:mount.lustre.0 Request processed in 1794us (2675us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601614.857684:0:16106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000004:00080000:0.0:1789601614.859530:0:14457:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2222us 00000001:00100000:0.0:1789601614.868896:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789601614.868924:0:7635:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000004:00200000:2.0:1789601614.874153:0:14457:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789601614.874333:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:13756:x1876532858564608:12345-192.168.201.30@tcp:33:mount.lustre.0 Request processed in 18500us (19222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601614.874349:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:3.0:1789601615.007744:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601615.007893:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858564736 00000100:00100000:0.0:1789601615.007907:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858564736 00000100:00100000:0.0:1789601615.007989:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:0.0:1789601615.008002:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:13802:x1876532858564736:12345-192.168.201.30@tcp:101:mkdir.0 00010000:00010000:0.0:1789601615.008030:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601615.008064:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ad2ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061448 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601615.008162:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ad306 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601615.008179:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ad306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601615.008209:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ad306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601615.008265:0:14454:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789601615.008270:0:14454:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789601615.008320:0:14454:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ad306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601615.008352:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ad2ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061448 expref: 8 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601615.008586:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ad306 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061448 expref: 7 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601615.008597:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd80dda00) 00010000:00010000:0.0:1789601615.008601:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789601615.008606:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924400, rc 0) 00000100:00100000:0.0:1789601615.008687:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+7:13802:x1876532858564736:12345-192.168.201.30@tcp:101:mkdir.0 Request processed in 686us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601615.008695:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00010000:00010000:3.0:1789601615.117426:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601615.817440:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601615.817478:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880581888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601615.817577:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601615.818546:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880581888 00000100:00100000:1.0:1789601615.818561:0:15143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880581888 00000100:00100000:1.0:1789601615.818632:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789601615.818645:0:15143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880581888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789601615.818681:0:15143:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601615.818770:0:15143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880581888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601615.818777:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789601615.818944:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880581888:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789601616.137297:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601617.161267:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601617.188580:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601617.188799:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858564864 00000100:00100000:1.0:1789601617.188823:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858564864 00000100:00100000:1.0:1789601617.188940:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:1.0:1789601617.188953:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+7:13855:x1876532858564864:12345-192.168.201.30@tcp:41:lfs.0 00000004:00000024:1.0:1789601617.189008:0:14456:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789601617.189139:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+7:13855:x1876532858564864:12345-192.168.201.30@tcp:41:lfs.0 Request processed in 189us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601617.189147:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00080000:2.0:1789601617.189753:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789601617.193075:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601617.193289:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858564992 00000100:00100000:1.0:1789601617.193306:0:15143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858564992 00000100:00100000:1.0:1789601617.193679:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:1.0:1789601617.193693:0:15143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:13855:x1876532858564992:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:1.0:1789601617.193749:0:15143:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601617.193903:0:15143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:13855:x1876532858564992:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 213us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601617.193932:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00080000:2.0:1789601617.194614:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601617.197724:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601617.197833:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858565120 00000100:00100000:1.0:1789601617.197871:0:15143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858565120 00000100:00100000:1.0:1789601617.197953:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:1.0:1789601617.197964:0:15143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:13855:x1876532858565120:12345-192.168.201.30@tcp:13:lfs.0 00002000:00000024:1.0:1789601617.198015:0:15143:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601617.198130:0:15143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:13855:x1876532858565120:12345-192.168.201.30@tcp:13:lfs.0 Request processed in 167us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601617.198138:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00080000:2.0:1789601617.198256:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601617.422098:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601617.422254:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858565248 00000100:00100000:2.0:1789601617.422272:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858565248 00000100:00100000:2.0:1789601617.422352:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:2.0:1789601617.422364:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+10:13885:x1876532858565248:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789601617.422386:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601617.422431:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edd8d8ca00/0xf3d6e402158ad30d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f506144f expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601617.422468:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edd8d8ca00/0xf3d6e402158ad30d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506144f expref: 11 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601617.422480:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edd8d8ca00/0xf3d6e402158ad30d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506144f expref: 11 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601617.422490:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8ca00, rc 0) 00000100:00100000:2.0:1789601617.422568:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+11:13885:x1876532858565248:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 207us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601617.422575:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 92 00000100:00100000:3.0:1789601617.432154:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601617.432262:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858565376 00000100:00100000:1.0:1789601617.432278:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858565376 00000100:00100000:1.0:1789601617.432352:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 93 00000100:00100000:1.0:1789601617.432364:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+11:13885:x1876532858565376:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789601617.432900:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aa8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+11:13885:x1876532858565376:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 535us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601617.432910:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 93 00000100:00100000:3.0:1789601617.448165:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601617.448313:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858565504 00000100:00100000:0.0:1789601617.448327:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858565504 00000100:00100000:0.0:1789601617.448401:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 94 00000100:00100000:0.0:1789601617.448414:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+11:13885:x1876532858565504:12345-192.168.201.30@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789601617.448832:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aaa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+11:13885:x1876532858565504:12345-192.168.201.30@tcp:503:mount.lustre.0 Request processed in 419us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601617.448881:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 94 00000100:00100000:3.0:1789601617.460525:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601617.460759:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858565632 00000100:00100000:2.0:1789601617.460773:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858565632 00000100:00100000:2.0:1789601617.460879:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 95 00000100:00100000:2.0:1789601617.460892:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+11:13893:x1876532858565632:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789601617.461404:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aa9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+11:13893:x1876532858565632:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 511us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601617.461414:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 95 00000100:00100000:2.0:1789601617.494188:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601617.494331:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858565760 00000100:00100000:1.0:1789601617.494345:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858565760 00000100:00100000:1.0:1789601617.494425:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 96 00000100:00100000:1.0:1789601617.494438:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+11:13893:x1876532858565760:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789601617.494832:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+11:13893:x1876532858565760:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 395us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601617.494881:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 96 00000100:00100000:3.0:1789601617.504971:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601617.505224:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858565888 00000100:00100000:0.0:1789601617.505238:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858565888 00000100:00100000:0.0:1789601617.505315:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:0.0:1789601617.505328:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+11:13885:x1876532858565888:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789601617.505352:0:14448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601617.505377:0:14448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ee00925c00/0xf3d6e402158ad314 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061479 expref: -99 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601617.505432:0:14448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ee00925c00/0xf3d6e402158ad314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061479 expref: 12 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601617.505447:0:14448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ee00925c00/0xf3d6e402158ad314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061479 expref: 12 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601617.505457:0:14448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00925c00, rc 0) 00000100:00100000:0.0:1789601617.505537:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+12:13885:x1876532858565888:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 212us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601617.505545:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 97 00000100:00100000:3.0:1789601617.511126:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601617.511412:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858566016 00000100:00100000:2.0:1789601617.511425:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858566016 00000100:00100000:2.0:1789601617.511503:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 98 00000100:00100000:2.0:1789601617.511516:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+12:13885:x1876532858566016:12345-192.168.201.30@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789601617.511554:0:14449:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789601617.511594:0:14449:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789601617.511605:0:14449:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789601617.511609:0:14449:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789601617.511612:0:14449:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789601617.522569:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+12:13885:x1876532858566016:12345-192.168.201.30@tcp:256:mount.lustre.0 Request processed in 11037us (11440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601617.522696:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 98 00000100:00100000:3.0:1789601617.529396:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601617.529619:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858566144 00000100:00100000:1.0:1789601617.529634:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858566144 00000100:00100000:1.0:1789601617.529709:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00100000:1.0:1789601617.529723:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+12:13885:x1876532858566144:12345-192.168.201.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789601617.529747:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601617.529772:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158ad31b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061480 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601617.529810:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158ad31b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061480 expref: 13 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601617.529822:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158ad31b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061480 expref: 13 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601617.529833:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c4a00, rc 0) 00000100:00100000:1.0:1789601617.529946:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+13:13885:x1876532858566144:12345-192.168.201.30@tcp:101:mount.lustre.0 Request processed in 224us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601617.529953:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 99 00000100:00100000:3.0:1789601617.539953:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601617.541038:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858566272 00000100:00100000:1.0:1789601617.541056:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858566272 00000100:00100000:1.0:1789601617.541169:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 100 00000100:00100000:1.0:1789601617.541182:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+13:13885:x1876532858566272:12345-192.168.201.30@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789601617.542169:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+13:13885:x1876532858566272:12345-192.168.201.30@tcp:501:mount.lustre.0 Request processed in 976us (2220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601617.542182:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 100 00000100:00100000:2.0:1789601617.562122:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601617.563712:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858566400 00000100:00100000:0.0:1789601617.563730:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858566400 00000100:00100000:0.0:1789601617.563823:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00100000:0.0:1789601617.563850:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+13:13885:x1876532858566400:12345-192.168.201.30@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789601617.565935:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+13:13885:x1876532858566400:12345-192.168.201.30@tcp:503:mount.lustre.0 Request processed in 2087us (3812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601617.565954:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 101 00000100:00100000:2.0:1789601617.570726:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601617.570886:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858566528 00000100:00100000:1.0:1789601617.570900:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858566528 00000100:00100000:1.0:1789601617.570973:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 102 00000100:00100000:1.0:1789601617.570986:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+13:13898:x1876532858566528:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789601617.572162:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+13:13898:x1876532858566528:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 1168us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601617.572178:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 102 00000100:00100000:2.0:1789601617.577677:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601617.577829:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858566656 00000100:00100000:0.0:1789601617.577880:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858566656 00000100:00100000:0.0:1789601617.577943:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:0.0:1789601617.577955:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+13:13898:x1876532858566656:12345-192.168.201.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789601617.584527:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+13:13898:x1876532858566656:12345-192.168.201.30@tcp:502:llog_process_th.0 Request processed in 6556us (6849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601617.584549:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 103 00000100:00100000:2.0:1789601617.593510:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601617.593718:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858566784 00000100:00100000:0.0:1789601617.593750:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858566784 00000100:00100000:0.0:1789601617.593814:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1789601617.593825:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2355:x1876532858566784:12345-192.168.201.30@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789601617.593919:0:16328:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from b6328b6e-fdda-4b75-9930-1671a349afd2@192.168.201.30@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:0.0:1789601617.593987:0:16328:0:(genops.c:1384:class_connect()) connect: client b6328b6e-fdda-4b75-9930-1671a349afd2, cookie 0xf3d6e402158ad322 00000004:00100000:0.0:1789601617.594036:0:16328:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789601617.594343:0:16328:0:(import.c:65:import_set_state_nolock()) ffff91edffa54800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601617.594487:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6328b6e-fdda-4b75-9930-1671a349afd2+6:2355:x1876532858566784:12345-192.168.201.30@tcp:38:mount.lustre.0 Request processed in 660us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601617.594496:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:2.0:1789601617.605895:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601617.606108:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601617.606138:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601617.606396:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858567296 00000100:00100000:1.0:1789601617.606411:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858567296 00000100:00100000:1.0:1789601617.606481:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858567424 00000100:00100000:1.0:1789601617.606485:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858567424 00000100:00100000:1.0:1789601617.606512:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:1.0:1789601617.606523:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:2357:x1876532858567296:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789601617.606612:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:2357:x1876532858567296:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 92us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601617.606620:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:1.0:1789601617.606637:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:1.0:1789601617.606643:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:2357:x1876532858567424:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789601617.606667:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:2357:x1876532858567424:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601617.606672:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:0.0:1789601617.609587:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858567168 00000100:00100000:0.0:1789601617.609613:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858567168 00000100:00100000:0.0:1789601617.609727:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:0.0:1789601617.609740:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+7:2357:x1876532858567168:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601617.609906:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+7:2357:x1876532858567168:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 168us (3796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601617.609915:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:3.0:1789601617.613610:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601617.613697:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858566912 00000100:00100000:0.0:1789601617.613712:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858566912 00000100:00100000:0.0:1789601617.613805:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1789601617.613817:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6328b6e-fdda-4b75-9930-1671a349afd2+6:0:x1876532858566912:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789601617.613876:0:14454:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1789601617.616405:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789601617.617096:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6328b6e-fdda-4b75-9930-1671a349afd2+6:0:x1876532858566912:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 3254us (3473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601617.617114:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:3.0:1789601617.620456:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601617.620573:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858567040 00000100:00100000:0.0:1789601617.620603:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858567040 00000100:00100000:0.0:1789601617.620714:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:0.0:1789601617.620728:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6328b6e-fdda-4b75-9930-1671a349afd2+6:13885:x1876532858567040:12345-192.168.201.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789601617.620771:0:14456:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789601617.620877:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6328b6e-fdda-4b75-9930-1671a349afd2+6:13885:x1876532858567040:12345-192.168.201.30@tcp:41:mount.lustre.0 Request processed in 152us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601617.620886:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:2.0:1789601617.623949:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601617.624446:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858567552 00000100:00100000:1.0:1789601617.624461:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858567552 00000100:00100000:1.0:1789601617.624576:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:1.0:1789601617.624591:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6328b6e-fdda-4b75-9930-1671a349afd2+6:13885:x1876532858567552:12345-192.168.201.30@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789601617.624731:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6328b6e-fdda-4b75-9930-1671a349afd2+6:13885:x1876532858567552:12345-192.168.201.30@tcp:40:mount.lustre.0 Request processed in 142us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601617.624740:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:2.0:1789601617.628434:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601617.628500:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601617.628542:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601617.628756:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858567936 00000100:00100000:0.0:1789601617.628770:0:14458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858567936 00000100:00100000:0.0:1789601617.628876:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:0.0:1789601617.628888:0:14458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6328b6e-fdda-4b75-9930-1671a349afd2+6:13885:x1876532858567936:12345-192.168.201.30@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789601617.628992:0:14458:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789601617.629104:0:14458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6328b6e-fdda-4b75-9930-1671a349afd2+6:13885:x1876532858567936:12345-192.168.201.30@tcp:33:mount.lustre.0 Request processed in 218us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601617.629112:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:3.0:1789601617.629680:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858567680 00000100:00100000:3.0:1789601617.629688:0:15142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858567680 00000100:00100000:0.0:1789601617.629868:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858567808 00000100:00100000:0.0:1789601617.629874:0:15142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858567808 00000100:00100000:0.0:1789601617.629896:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1789601617.629902:0:15142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1876532858567680:12345-192.168.201.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789601617.629939:0:15142:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from b6328b6e-fdda-4b75-9930-1671a349afd2@192.168.201.30@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:0.0:1789601617.629982:0:15142:0:(genops.c:1384:class_connect()) connect: client b6328b6e-fdda-4b75-9930-1671a349afd2, cookie 0xf3d6e402158ad329 00002000:00100000:0.0:1789601617.629997:0:15142:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b6328b6e-fdda-4b75-9930-1671a349afd2/ffff91edffa56800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789601617.630011:0:15142:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789601617.630507:0:16106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:3.0:1789601617.630515:0:16106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2355:x1876532858567808:12345-192.168.201.30@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789601617.630539:0:16106:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from b6328b6e-fdda-4b75-9930-1671a349afd2@192.168.201.30@tcp t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:3.0:1789601617.630564:0:16106:0:(genops.c:1384:class_connect()) connect: client b6328b6e-fdda-4b75-9930-1671a349afd2, cookie 0xf3d6e402158ad330 00002000:00100000:3.0:1789601617.630571:0:16106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b6328b6e-fdda-4b75-9930-1671a349afd2/ffff91ecc18c8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789601617.630579:0:16106:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789601617.630707:0:16106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789601617.630748:0:16106:0:(import.c:65:import_set_state_nolock()) ffff91ecc18cf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789601617.630952:0:16106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6328b6e-fdda-4b75-9930-1671a349afd2+6:2355:x1876532858567808:12345-192.168.201.30@tcp:8:mount.lustre.0 Request processed in 434us (2407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601617.630961:0:16106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00002000:00080000:0.0:1789601617.631342:0:15142:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789601617.631362:0:15142:0:(import.c:65:import_set_state_nolock()) ffff91edffa50000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789601617.631471:0:15142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6328b6e-fdda-4b75-9930-1671a349afd2+6:2355:x1876532858567680:12345-192.168.201.30@tcp:8:mount.lustre.0 Request processed in 1567us (2970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601617.631480:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1789601617.799498:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601617.799613:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858568064 00000100:00100000:1.0:1789601617.799627:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858568064 00000100:00100000:1.0:1789601617.799699:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:1.0:1789601617.799710:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6328b6e-fdda-4b75-9930-1671a349afd2+6:13919:x1876532858568064:12345-192.168.201.30@tcp:101:mkdir.0 00010000:00010000:1.0:1789601617.799739:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601617.799769:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad337 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50614aa expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601617.799894:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5800/0xf3d6e402158ad33e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601617.799912:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5800/0xf3d6e402158ad33e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601617.799926:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5800/0xf3d6e402158ad33e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601617.799972:0:14455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789601617.799976:0:14455:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789601617.800000:0:14455:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5800/0xf3d6e402158ad33e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601617.800028:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad337 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614aa expref: 8 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601617.800050:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5800/0xf3d6e402158ad33e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614aa expref: 7 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601617.800089:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd80dda00) 00010000:00010000:1.0:1789601617.800093:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789601617.800098:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c5800, rc 0) 00000100:00100000:1.0:1789601617.800373:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6328b6e-fdda-4b75-9930-1671a349afd2+7:13919:x1876532858568064:12345-192.168.201.30@tcp:101:mkdir.0 Request processed in 662us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601617.800381:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00010000:00010000:3.0:1789601618.188588:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789601619.025863:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b6328b6e-fdda-4b75-9930-1671a349afd2 00000001:00100000:3.0:1789601619.025883:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9e82277c-40aa-4559-8a65-5f21a02d7d72 00010000:00010000:1.0:1789601619.229464:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601619.913247:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789601619.913283:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880582016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601619.913409:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601619.913983:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880582016 00000100:00100000:2.0:1789601619.913997:0:15143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880582016 00000100:00100000:2.0:1789601619.914079:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789601619.914090:0:15143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2ed3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880582016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789601619.914151:0:15143:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789601619.914160:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789601619.914236:0:15143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2ed3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1876532880582016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601619.914244:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789601619.914385:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3317:1876532880582144:0@lo:400:kworker.0 00000100:00100000:3.0:1789601619.914406:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880582528:0@lo:400:kworker.0 00000100:00100000:2.0:1789601619.914429:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601619.914455:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601619.914463:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880582656:0@lo:400:kworker.0 00000100:00100000:3.0:1789601619.914489:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789601619.914490:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601619.914495:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880582400:0@lo:400:kworker.0 00000100:00100000:2.0:1789601619.914506:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601619.914514:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601619.914519:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880582272:0@lo:400:kworker.0 00000100:00100000:2.0:1789601619.914548:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601619.914561:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880582144 00000100:00100000:3.0:1789601619.914565:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880582144 00000100:00100000:3.0:1789601619.914614:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789601619.914622:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:3317:x1876532880582144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601619.914662:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:3317:x1876532880582144:12345-0@lo:400:kworker.0 Request processed in 40us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601619.914678:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789601619.914709:0:16106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880582272 00000100:00100000:3.0:1789601619.914713:0:16106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880582272 00000100:00100000:3.0:1789601619.914756:0:16106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789601619.914763:0:16106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880582272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601619.914795:0:16106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880582272:12345-0@lo:400:kworker.0 Request processed in 33us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601619.914801:0:16106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789601619.914868:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880582272:0@lo:400:kworker.0 00000100:00100000:3.0:1789601619.914881:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3317:1876532880582144:0@lo:400:kworker.0 00000100:00080000:2.0:1789601619.914945:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601619.915076:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880582528 00000100:00100000:1.0:1789601619.915081:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880582528 00000100:00100000:1.0:1789601619.915132:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880582656 00000100:00100000:1.0:1789601619.915135:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880582656 00000100:00100000:1.0:1789601619.915150:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880582400 00000100:00100000:1.0:1789601619.915152:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880582400 00000100:00100000:1.0:1789601619.915165:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789601619.915172:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880582528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601619.915220:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880582528:12345-0@lo:400:kworker.0 Request processed in 48us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601619.915226:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789601619.915240:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789601619.915246:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880582656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601619.915276:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3317:x1876532880582656:12345-0@lo:400:kworker.0 Request processed in 30us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601619.915281:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789601619.915290:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789601619.915295:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880582400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789601619.915331:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1876532880582400:12345-0@lo:400:kworker.0 Request processed in 36us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601619.915337:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789601619.915365:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3320:1876532880582400:0@lo:400:kworker.0 00000100:00100000:1.0:1789601619.915376:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880582528:0@lo:400:kworker.0 00000100:00100000:1.0:1789601619.915414:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789601619.915434:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3319:1876532880582016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789601619.915456:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3317:1876532880582656:0@lo:400:kworker.0 00000100:00080000:2.0:1789601619.915756:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1789601619.979000:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b6328b6e-fdda-4b75-9930-1671a349afd2 00000001:00100000:0.0:1789601619.979020:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9e82277c-40aa-4559-8a65-5f21a02d7d72 00000001:00100000:1.0:1789601619.989114:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9e82277c-40aa-4559-8a65-5f21a02d7d72 00000001:00100000:1.0:1789601619.989134:0:7635:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b6328b6e-fdda-4b75-9930-1671a349afd2 00010000:00010000:0.0:1789601620.233264:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789601620.944443:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601620.944479:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880582784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789601620.944581:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601620.944693:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880582784 00000100:00100000:3.0:1789601620.944704:0:15143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880582784 00000100:00100000:3.0:1789601620.944766:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789601620.944800:0:15143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880582784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789601620.944876:0:15143:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789601620.945402:0:15143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880582784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 604us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601620.945412:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789601620.947874:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880582784:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1789601621.048263:0:16422:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789601621.257556:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789601622.089759:0:14486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789601622.284672:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601623.005058:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601623.005114:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601623.005143:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601623.005174:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601623.005192:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601623.005209:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601623.005235:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601623.005266:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858568576 00000100:00100000:2.0:1789601623.005279:0:15140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858568576 00000100:00100000:2.0:1789601623.005348:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858568832 00000100:00100000:2.0:1789601623.005351:0:15140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858568832 00000100:00100000:2.0:1789601623.005367:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858568448 00000100:00100000:2.0:1789601623.005368:0:15140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858568448 00000100:00100000:2.0:1789601623.005375:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858568960 00000100:00100000:2.0:1789601623.005377:0:15140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858568960 00000100:00100000:2.0:1789601623.005389:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1789601623.005397:0:15140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+5:2358:x1876532858568576:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601623.005481:0:15140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+5:2358:x1876532858568576:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 84us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601623.005490:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1789601623.005509:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:2.0:1789601623.005515:0:15140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6328b6e-fdda-4b75-9930-1671a349afd2+5:2358:x1876532858568832:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601623.005550:0:15140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6328b6e-fdda-4b75-9930-1671a349afd2+5:2358:x1876532858568832:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 35us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601623.005557:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:2.0:1789601623.005567:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:2.0:1789601623.005572:0:15140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+5:2358:x1876532858568448:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601623.005592:0:15140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+5:2358:x1876532858568448:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 20us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601623.005598:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:2.0:1789601623.005609:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:2.0:1789601623.005615:0:15140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6328b6e-fdda-4b75-9930-1671a349afd2+5:2358:x1876532858568960:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601623.005645:0:15140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6328b6e-fdda-4b75-9930-1671a349afd2+5:2358:x1876532858568960:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 29us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601623.005652:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:2.0:1789601623.005672:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858568192 00000100:00100000:2.0:1789601623.005677:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858568192 00000100:00100000:2.0:1789601623.005704:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 105 00000100:00100000:2.0:1789601623.005711:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+13:2358:x1876532858568192:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601623.005738:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+13:2358:x1876532858568192:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601623.005745:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 105 00000100:00100000:2.0:1789601623.005790:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858568320 00000100:00100000:2.0:1789601623.005794:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858568320 00000100:00100000:2.0:1789601623.005825:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858568704 00000100:00100000:2.0:1789601623.005828:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858568704 00000100:00100000:2.0:1789601623.005892:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:2.0:1789601623.005898:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:2358:x1876532858568320:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601623.005930:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:2358:x1876532858568320:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 32us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601623.005936:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:2.0:1789601623.005948:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:2.0:1789601623.005954:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6328b6e-fdda-4b75-9930-1671a349afd2+6:2358:x1876532858568704:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601623.005996:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6328b6e-fdda-4b75-9930-1671a349afd2+6:2358:x1876532858568704:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 24us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601623.006003:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00080000:2.0:1789601623.006026:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789601623.006033:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789601623.006035:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789601623.307744:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601624.329103:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601625.034639:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf83bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880583040:0@lo:400:kworker.0 00000100:00100000:0.0:1789601625.034737:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601625.034799:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf83bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880583552:0@lo:400:kworker.0 00000100:00100000:0.0:1789601625.034828:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601625.034890:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789601625.034898:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf83bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3320:1876532880582912:0@lo:400:kworker.0 00000100:00100000:0.0:1789601625.034931:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601625.034965:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf83bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880583424:0@lo:400:kworker.0 00000100:00100000:0.0:1789601625.034988:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601625.035017:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf83be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880583168:0@lo:400:kworker.0 00000100:00100000:0.0:1789601625.035042:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601625.035179:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880582912 00000100:00100000:3.0:1789601625.035190:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880582912 00000100:00100000:3.0:1789601625.035248:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789601625.035259:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:3320:x1876532880582912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601625.035325:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:3320:x1876532880582912:12345-0@lo:400:kworker.0 Request processed in 68us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601625.035333:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789601625.035393:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789601625.035403:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf83bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880583296:0@lo:400:kworker.0 00000100:00100000:0.0:1789601625.035432:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601625.035532:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880583040 00000100:00100000:0.0:1789601625.035537:0:15140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880583040 00000100:00100000:0.0:1789601625.035582:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880583168 00000100:00100000:0.0:1789601625.035586:0:15140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880583168 00000100:00100000:0.0:1789601625.035612:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789601625.035619:0:15140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880583040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601625.035656:0:15140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880583040:12345-0@lo:400:kworker.0 Request processed in 38us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601625.035663:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789601625.035677:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789601625.035683:0:15140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880583168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601625.035718:0:15140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880583168:12345-0@lo:400:kworker.0 Request processed in 35us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601625.035724:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789601625.043890:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880583552 00000100:00100000:3.0:1789601625.043915:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880583552 00000100:00100000:3.0:1789601625.043998:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880583424 00000100:00100000:3.0:1789601625.044002:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880583424 00000100:00100000:3.0:1789601625.044020:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880583296 00000100:00100000:3.0:1789601625.044024:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880583296 00000100:00100000:3.0:1789601625.044046:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789601625.044057:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880583552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601625.044185:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1876532880583552:12345-0@lo:400:kworker.0 Request processed in 130us (9355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601625.044193:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789601625.044212:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789601625.044218:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880583424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601625.044265:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1876532880583424:12345-0@lo:400:kworker.0 Request processed in 47us (9276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601625.044272:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789601625.044284:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789601625.044291:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880583296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789601625.044318:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880583296:12345-0@lo:400:kworker.0 Request processed in 28us (8885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601625.044324:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1789601625.045912:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789601625.045923:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601625.045927:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601625.046123:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf83bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3320:1876532880582912:0@lo:400:kworker.0 00000100:00100000:1.0:1789601625.046147:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf83bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3320:1876532880583424:0@lo:400:kworker.0 00000100:00100000:1.0:1789601625.046162:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf83bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880583040:0@lo:400:kworker.0 00000100:00100000:1.0:1789601625.046174:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf83bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3320:1876532880583552:0@lo:400:kworker.0 00000100:00100000:0.0:1789601625.046494:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789601625.046515:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880583680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789601625.046594:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601625.048273:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf83bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880583296:0@lo:400:kworker.0 00000100:00100000:0.0:1789601625.048293:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf83be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880583168:0@lo:400:kworker.0 00000100:00100000:1.0:1789601625.054315:0:15143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880583680 00000100:00100000:1.0:1789601625.054338:0:15143:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880583680 00000100:00100000:1.0:1789601625.055182:0:15143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789601625.055198:0:15143:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880583680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789601625.055253:0:15143:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789601625.055383:0:15143:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880583680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 189us (8789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601625.055392:0:15143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789601625.056237:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880583680:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1789601625.152534:0:16571:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3b7816d0 20000000:00000080:1.0:1789601625.152558:0:16571:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91edf7e48800 uarg=0000000000000000 20000000:01000000:1.0:1789601625.152607:0:16571:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789601625.152614:0:16571:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789601625.152620:0:16571:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789601625.154436:0:16572:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1789601625.154617:0:16571:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789601625.160399:0:16571:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789601625.160445:0:16571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91edc29c4c00/0xf3d6e402158ad345 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601625.160469:0:16571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91ee00925000/0xf3d6e402158ad03c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ad035 expref: 18 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601625.160477:0:16571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edffadc400/0xf3d6e402158ad089 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ad082 expref: 18 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601625.160485:0:16571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edffadda00/0xf3d6e402158ad1c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ad1bd expref: 18 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601625.160496:0:16571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc29c4800/0xf3d6e402158ad2e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506141e expref: 12 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601625.160503:0:16571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158ad31b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061480 expref: 12 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601625.160511:0:16571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91edc29c4c00/0xf3d6e402158ad345 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601625.160593:0:16571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158ad31b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061480 expref: 12 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601625.160612:0:16571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158ad31b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061480 expref: 12 pid: 14447 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601625.160631:0:16571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa5b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16571:1876532880583808:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601625.161238:0:16571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edc29c4800/0xf3d6e402158ad2e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506141e expref: 12 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601625.161249:0:16571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91edc29c4800/0xf3d6e402158ad2e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506141e expref: 12 pid: 14447 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601625.161258:0:16571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa5b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16571:1876532880583936:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601625.162243:0:16571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edffadda00/0xf3d6e402158ad1c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158ad1bd expref: 18 pid: 14448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601625.162259:0:16571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91edffadda00/0xf3d6e402158ad1c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158ad1bd expref: 18 pid: 14448 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601625.162274:0:16571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa58700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16571:1876532880584064:0@lo:104: 00000100:00100000:1.0:1789601625.162988:0:16571:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789601625.163108:0:16571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91edffadc400/0xf3d6e402158ad089 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158ad082 expref: 18 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601625.163120:0:16571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91edffadc400/0xf3d6e402158ad089 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158ad082 expref: 18 pid: 14449 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601625.163151:0:16571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa5bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16571:1876532880584192:0@lo:104: 00000100:00100000:1.0:1789601625.163180:0:16571:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789601625.163767:0:16571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91ee00925000/0xf3d6e402158ad03c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf3d6e402158ad035 expref: 18 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601625.163790:0:16571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91ee00925000/0xf3d6e402158ad03c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf3d6e402158ad035 expref: 18 pid: 14449 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601625.163800:0:16571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa58a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16571:1876532880584320:0@lo:104: 00000100:00100000:1.0:1789601625.163866:0:16571:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601625.164202:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880584064 00000100:00100000:2.0:1789601625.164213:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880584064 00000100:00100000:2.0:1789601625.164267:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880584192 00000100:00100000:2.0:1789601625.164270:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880584192 00000100:00100000:2.0:1789601625.164286:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789601625.164296:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+4:16571:x1876532880584064:12345-0@lo:104: 00010000:00010000:2.0:1789601625.164312:0:14438:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edc29c5c00/0xf3d6e402158ad1bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158ad1c4 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.164401:0:14438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789601625.164407:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+4:16571:x1876532880584064:12345-0@lo:104: Request processed in 113us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601625.164429:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789601625.164450:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789601625.164456:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+3:16571:x1876532880584192:12345-0@lo:104: 00010000:00010000:2.0:1789601625.164464:0:14438:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91ee00924c00/0xf3d6e402158ad082 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158ad089 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.164507:0:14438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789601625.164513:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+3:16571:x1876532880584192:12345-0@lo:104: Request processed in 58us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601625.164518:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789601625.164537:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789601625.164543:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edc29c5c00/0xf3d6e402158ad1bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158ad1c4 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.164551:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5c00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:2.0:1789601625.164557:0:14443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c5c00/0xf3d6e402158ad1bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158ad1c4 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.164566:0:14443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edc29c5c00/0xf3d6e402158ad1bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158ad1c4 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601625.164574:0:14443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edc29c5c00/0xf3d6e402158ad1bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158ad1c4 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601625.164581:0:14443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789601625.164619:0:14443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edc29c5c00/0xf3d6e402158ad1bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ad1c4 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.164626:0:14443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601625.164657:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edc29c5c00/0xf3d6e402158ad1bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ad1c4 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.164665:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edc29c5c00/0xf3d6e402158ad1bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ad1c4 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.164681:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601625.164684:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91ee00924c00/0xf3d6e402158ad082 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158ad089 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.164690:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924c00 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:2.0:1789601625.164693:0:14443:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91ee00924c00/0xf3d6e402158ad082 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158ad089 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.164700:0:14443:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91ee00924c00/0xf3d6e402158ad082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158ad089 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789601625.164706:0:14443:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91ee00924c00/0xf3d6e402158ad082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158ad089 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789601625.164712:0:14443:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789601625.164726:0:14443:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91ee00924c00/0xf3d6e402158ad082 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ad089 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.164732:0:14443:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789601625.164750:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91ee00924c00/0xf3d6e402158ad082 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ad089 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.164757:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91ee00924c00/0xf3d6e402158ad082 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ad089 expref: -99 pid: 15138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.164790:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601625.164793:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601625.164794:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601625.164819:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3318:1876532880584448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601625.164878:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601625.164931:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3319:1876532880584576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601625.164965:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789601625.165239:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601625.165466:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880584448 00000100:00100000:2.0:1789601625.165474:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880584448 00010000:00010000:2.0:1789601625.165506:0:14439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edffadda00/0xf3d6e402158ad1c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158ad1bd expref: 19 pid: 14448 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601625.165540:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880584576 00000100:00100000:2.0:1789601625.165543:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880584576 00010000:00010000:2.0:1789601625.165553:0:14439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edffadc400/0xf3d6e402158ad089 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158ad082 expref: 20 pid: 14449 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601625.165567:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789601625.165574:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+20:3318:x1876532880584448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789601625.165587:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601625.165593:0:14439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edffadda00/0xf3d6e402158ad1c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158ad1bd expref: 20 pid: 14448 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.165604:0:14439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edffadda00/0xf3d6e402158ad1c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158ad1bd expref: 20 pid: 14448 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.165625:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601625.165671:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+20:3318:x1876532880584448:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601625.165693:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789601625.165708:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789601625.165714:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:3319:x1876532880584576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789601625.165721:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601625.165726:0:14439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edffadc400/0xf3d6e402158ad089 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158ad082 expref: 19 pid: 14449 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.165734:0:14439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edffadc400/0xf3d6e402158ad089 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158ad082 expref: 19 pid: 14449 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.165743:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601625.165787:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:3319:x1876532880584576:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601625.165794:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789601625.165863:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3319:1876532880584576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789601625.165892:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3318:1876532880584448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601625.166365:0:16571:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8dcb840 going to sleep for 11 seconds 00010000:00010000:1.0:1789601625.166385:0:16571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edffadda00/0xf3d6e402158ad1c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158ad1bd expref: 18 pid: 14448 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601625.166398:0:16571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa58700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16571:1876532880584064:0@lo:104: 00010000:00010000:1.0:1789601625.166408:0:16571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edffadc400/0xf3d6e402158ad089 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158ad082 expref: 17 pid: 14449 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601625.166415:0:16571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa5bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16571:1876532880584192:0@lo:104: 00000100:00100000:2.0:1789601625.166583:0:14438:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789601625.166599:0:14438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880584320 00000100:00100000:2.0:1789601625.166605:0:14438:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880584320 00000100:00100000:2.0:1789601625.166630:0:14438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789601625.166637:0:14438:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee019d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+3:16571:x1876532880584320:12345-0@lo:104: 00010000:00010000:2.0:1789601625.166651:0:14438:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.130@tcp lock: ffff91edffadc600/0xf3d6e402158ad035 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158ad03c expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.166755:0:14438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789601625.166761:0:14438:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee019d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+3:16571:x1876532880584320:12345-0@lo:104: Request processed in 125us (2895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601625.166788:0:14438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789601625.166994:0:16571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa58a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16571:1876532880584320:0@lo:104: 00010000:00010000:0.0:1789601625.167194:0:14442:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789601625.167203:0:14442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.130@tcp lock: ffff91edffadc600/0xf3d6e402158ad035 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf3d6e402158ad03c expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601625.167211:0:14442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edffadc600 already unused, calling callback (ffffffffc1df7c20) 10000000:00010000:0.0:1789601625.167224:0:14442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.130@tcp lock: ffff91edffadc600/0xf3d6e402158ad035 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf3d6e402158ad03c expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601625.167234:0:14442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.130@tcp lock: ffff91edffadc600/0xf3d6e402158ad035 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf3d6e402158ad03c expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789601625.167242:0:14442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.130@tcp lock: ffff91edffadc600/0xf3d6e402158ad035 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf3d6e402158ad03c expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789601625.167249:0:14442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789601625.167294:0:14442:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.130@tcp lock: ffff91edffadc600/0xf3d6e402158ad035 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ad03c expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601625.167302:0:14442:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789601625.167352:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf83be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3320:1876532880584704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789601625.167400:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601625.167466:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880584704 00000100:00100000:2.0:1789601625.167472:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880584704 00010000:00010000:2.0:1789601625.167495:0:14439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91ee00925000/0xf3d6e402158ad03c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158ad035 expref: 17 pid: 14449 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601625.167519:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789601625.167525:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+17:3320:x1876532880584704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789601625.167535:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601625.167540:0:14439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91ee00925000/0xf3d6e402158ad03c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf3d6e402158ad035 expref: 17 pid: 14449 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.167550:0:14439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91ee00925000/0xf3d6e402158ad03c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf3d6e402158ad035 expref: 17 pid: 14449 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.167565:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91ee00925000/0xf3d6e402158ad03c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf3d6e402158ad035 expref: 17 pid: 14449 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.167580:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789601625.167627:0:14442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.130@tcp lock: ffff91edffadc600/0xf3d6e402158ad035 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ad03c expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601625.167635:0:14442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.130@tcp lock: ffff91edffadc600/0xf3d6e402158ad035 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf3d6e402158ad03c expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601625.167653:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601625.167656:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601625.167657:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601625.167802:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:3320:x1876532880584704:12345-0@lo:103:ldlm_bl.0 Request processed in 276us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601625.167810:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789601625.168292:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf83be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3320:1876532880584704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789601625.168811:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601625.168873:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601625.169033:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858569088 00000100:00100000:0.0:1789601625.169040:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858569088 00010000:00010000:0.0:1789601625.169084:0:14441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158ad31b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061480 expref: 13 pid: 14447 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601625.169109:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858569216 00000100:00100000:0.0:1789601625.169113:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858569216 00010000:00010000:0.0:1789601625.169125:0:14441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91edc29c4800/0xf3d6e402158ad2e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506141e expref: 14 pid: 14447 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601625.169164:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:0.0:1789601625.169173:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f5cf11-52eb-460f-b02c-b9251b294d39+14:2357:x1876532858569088:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601625.169187:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601625.169192:0:14441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158ad31b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061480 expref: 14 pid: 14447 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601625.169204:0:14441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158ad31b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061480 expref: 14 pid: 14447 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601625.169227:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601625.169282:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f5cf11-52eb-460f-b02c-b9251b294d39+14:2357:x1876532858569088:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 110us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601625.169289:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:0.0:1789601625.169307:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:0.0:1789601625.169314:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f5cf11-52eb-460f-b02c-b9251b294d39+13:2356:x1876532858569216:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601625.169322:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601625.169326:0:14441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91edc29c4800/0xf3d6e402158ad2e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506141e expref: 13 pid: 14447 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601625.169336:0:14441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91edc29c4800/0xf3d6e402158ad2e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506141e expref: 13 pid: 14447 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601625.169349:0:14441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91edc29c4c00/0xf3d6e402158ad345 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601625.169359:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c4c00/0xf3d6e402158ad345 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601625.169382:0:14441:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edc29c4c00/0xf3d6e402158ad345 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601625.169389:0:14441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91edc29c4c00/0xf3d6e402158ad345 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601625.169396:0:14441:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91edc29c4c00/0xf3d6e402158ad345 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601625.169404:0:14441:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91edc29c4c00/0xf3d6e402158ad345 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601625.169410:0:14441:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4c00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601625.169415:0:14441:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91edc29c4c00/0xf3d6e402158ad345 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601625.169425:0:14441:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91edc29c4c00/0xf3d6e402158ad345 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601625.169435:0:14441:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91edc29c4c00/0xf3d6e402158ad345 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601625.169446:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601625.169469:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:15f5cf11-52eb-460f-b02c-b9251b294d39+13:2356:x1876532858569216:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 155us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601625.169476:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00010000:00010000:1.0:1789601625.170402:0:16571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc29c4a00/0xf3d6e402158ad31b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061480 expref: 12 pid: 14447 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601625.170441:0:16571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa5b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16571:1876532880583808:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601625.170458:0:16571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc29c4800/0xf3d6e402158ad2e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506141e expref: 11 pid: 14447 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601625.170467:0:16571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa5b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16571:1876532880583936:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601625.170503:0:16571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91edc29c4c00/0xf3d6e402158ad345 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601625.170512:0:16571:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91edc29c4c00/0xf3d6e402158ad345 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601625.170518:0:16571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91edc29c4c00/0xf3d6e402158ad345 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601625.170524:0:16571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91edc29c4c00/0xf3d6e402158ad345 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601625.353543:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789601626.059279:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880584832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789601626.059377:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601626.059566:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880584832 00000100:00100000:3.0:1789601626.059578:0:15144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880584832 00000100:00100000:3.0:1789601626.059647:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789601626.059658:0:15144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880584832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789601626.059706:0:15144:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789601626.059764:0:15144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880584832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601626.059771:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789601626.060283:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880584832:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789601626.377281:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601626.839656:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601626.839716:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858569344 00000100:00100000:3.0:1789601626.839731:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858569344 00000100:00100000:3.0:1789601626.839817:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 107 00000100:00100000:3.0:1789601626.839832:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+11:13771:x1876532858569344:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601626.839882:0:14449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601626.839920:0:14449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc3b88000/0xf3d6e402158ad34c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f50614b1 expref: -99 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.839971:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc3b88000/0xf3d6e402158ad34c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614b1 expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.839986:0:14449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc3b88000/0xf3d6e402158ad34c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614b1 expref: 12 pid: 14449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.839997:0:14449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88000, rc 0) 00000100:00100000:3.0:1789601626.840078:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+12:13771:x1876532858569344:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 251us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601626.840086:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 107 00000100:00100000:2.0:1789601626.850470:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601626.850562:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858569472 00000100:00100000:3.0:1789601626.850575:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858569472 00000100:00100000:3.0:1789601626.850651:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 108 00000100:00100000:3.0:1789601626.850663:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+12:13771:x1876532858569472:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601626.851202:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+12:13771:x1876532858569472:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 539us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601626.851211:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 108 00000100:00100000:3.0:1789601626.853881:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601626.853989:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858569600 00000100:00100000:2.0:1789601626.854021:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858569600 00000100:00100000:2.0:1789601626.854136:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 109 00000100:00100000:2.0:1789601626.854147:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+12:13771:x1876532858569600:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601626.854438:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+12:13771:x1876532858569600:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 292us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601626.854447:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 109 00000100:00100000:0.0:1789601626.869465:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601626.869773:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858569728 00000100:00100000:1.0:1789601626.869789:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858569728 00000100:00100000:1.0:1789601626.869890:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 110 00000100:00100000:1.0:1789601626.869903:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+12:13771:x1876532858569728:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601626.869936:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601626.869962:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc29c4800/0xf3d6e402158ad353 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfba567d4f50614b8 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601626.870006:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc29c4800/0xf3d6e402158ad353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614b8 expref: 13 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601626.870054:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc29c4800/0xf3d6e402158ad353 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614b8 expref: 13 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601626.870065:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c4800, rc 0) 00000100:00100000:1.0:1789601626.870138:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+13:13771:x1876532858569728:12345-192.168.201.30@tcp:101:ll_cfg_requeue.0 Request processed in 238us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601626.870146:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 110 00000100:00100000:0.0:1789601626.872670:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601626.872771:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858569856 00000100:00100000:3.0:1789601626.872785:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858569856 00000100:00100000:3.0:1789601626.873729:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00100000:3.0:1789601626.873746:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+13:13771:x1876532858569856:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601626.874582:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+13:13771:x1876532858569856:12345-192.168.201.30@tcp:501:ll_cfg_requeue.0 Request processed in 833us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601626.874595:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 111 00000100:00100000:3.0:1789601626.882275:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601626.882448:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858569984 00000100:00100000:2.0:1789601626.882465:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858569984 00000100:00100000:2.0:1789601626.882599:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 112 00000100:00100000:2.0:1789601626.882613:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+13:13771:x1876532858569984:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789601626.883272:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:15f5cf11-52eb-460f-b02c-b9251b294d39+13:13771:x1876532858569984:12345-192.168.201.30@tcp:503:ll_cfg_requeue.0 Request processed in 657us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601626.883284:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 112 10000000:01000000:3.0:1789601626.965775:0:14451:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789601626.965785:0:14451:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91edf9d54800 from 10 10000000:01000000:3.0:1789601626.965791:0:14451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789601626.965882:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89c00/0xf3d6e402158ad35a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.965897:0:14451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc3b89c00/0xf3d6e402158ad35a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.965921:0:14451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc3b89c00/0xf3d6e402158ad35a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601626.965956:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880584960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789601626.966243:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601626.966315:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc5386c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789601626.966575:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880584960 00000100:00100000:0.0:1789601626.966607:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880584960 00000100:00100000:0.0:1789601626.966746:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789601626.966758:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+16:14451:x1876532880584960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789601626.966779:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601626.966797:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91ee00925800/0xf3d6e402158ad361 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158ad35a expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601626.966829:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91ee00925800/0xf3d6e402158ad361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158ad35a expref: 17 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601626.966877:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91ee00925800/0xf3d6e402158ad361 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ad35a expref: 17 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601626.966887:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00925800, rc 0) 00000100:00100000:0.0:1789601626.966965:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+17:14451:x1876532880584960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 208us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601626.966972:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789601626.967090:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880584960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789601626.967108:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc3b89c00/0xf3d6e402158ad35a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad361 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601626.967118:0:14451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc3b89c00/0xf3d6e402158ad35a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ad361 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601626.967200:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880585088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601626.967237:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601626.967279:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8dcb180 going to sleep for 11 seconds 00000100:00100000:0.0:1789601626.967393:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880585088 00000100:00100000:0.0:1789601626.967399:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880585088 00000100:00100000:0.0:1789601626.967433:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789601626.967441:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+17:14451:x1876532880585088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789601626.967832:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+17:14451:x1876532880585088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 390us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601626.967880:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789601626.968166:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880585088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789601626.968213:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880585216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789601626.968265:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789601626.968298:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8dcb180 going to sleep for 11 seconds 00000100:00100000:0.0:1789601626.968345:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880585216 00000100:00100000:0.0:1789601626.968353:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880585216 00000100:00100000:0.0:1789601626.968390:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789601626.968396:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+17:14451:x1876532880585216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789601626.969005:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+17:14451:x1876532880585216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 607us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601626.969015:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789601626.972401:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa5b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880585216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789601626.973499:0:16649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789601626.973999:0:14451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789601626.974038:0:14451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789601626.974052:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89c00/0xf3d6e402158ad35a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad361 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.974067:0:14451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc3b89c00/0xf3d6e402158ad35a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad361 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601626.974081:0:14451:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789601626.974084:0:14451:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91ee00b08800 from 10 10000000:01000000:3.0:1789601626.974087:0:14451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789601626.974137:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158ad368 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.974146:0:14451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158ad368 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.974174:0:14451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158ad368 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601626.974206:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880585344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789601626.974301:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601626.974365:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc5386c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789601626.974472:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880585344 00000100:00100000:2.0:1789601626.974482:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880585344 00000100:00100000:2.0:1789601626.974543:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789601626.974554:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+17:14451:x1876532880585344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789601626.974570:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601626.974584:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edd8d8d200/0xf3d6e402158ad36f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158ad368 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601626.974614:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edd8d8d200/0xf3d6e402158ad36f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158ad368 expref: 18 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601626.974626:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edd8d8d200/0xf3d6e402158ad36f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ad368 expref: 18 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601626.974648:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8d200, rc 0) 00000100:00100000:2.0:1789601626.974713:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+18:14451:x1876532880585344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601626.974720:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789601626.974896:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880585344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601626.974920:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158ad368 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad36f expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.974930:0:14451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158ad368 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ad36f expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601626.975003:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880585472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601626.975126:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601626.975153:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc5386c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789601626.975198:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880585472 00000100:00100000:2.0:1789601626.975203:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880585472 00000100:00100000:2.0:1789601626.975238:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789601626.975246:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+18:14451:x1876532880585472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789601626.975556:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+18:14451:x1876532880585472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 310us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601626.975564:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789601626.976183:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880585472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601626.976237:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880585600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601626.976291:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601626.976322:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc5386c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601626.976341:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880585600 00000100:00100000:3.0:1789601626.976346:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880585600 00000100:00100000:3.0:1789601626.976384:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789601626.976391:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+18:14451:x1876532880585600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601626.976631:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+18:14451:x1876532880585600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601626.976646:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789601626.977257:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880585600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789601626.978148:0:16650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789601626.978252:0:14451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789601626.978292:0:14451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789601626.978305:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158ad368 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad36f expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.978319:0:14451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc3b89800/0xf3d6e402158ad368 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad36f expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789601626.978333:0:14451:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789601626.978337:0:14451:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91edc5026000 from 10 10000000:01000000:3.0:1789601626.978340:0:14451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789601626.978390:0:14451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ad376 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.978400:0:14451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ad376 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.978414:0:14451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ad376 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601626.978443:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880585728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789601626.978528:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601626.978574:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc5386c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601626.978595:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880585728 00000100:00100000:3.0:1789601626.978602:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880585728 00000100:00100000:3.0:1789601626.978659:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789601626.978668:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+18:14451:x1876532880585728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601626.978685:0:14447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601626.978702:0:14447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91edc3b89200/0xf3d6e402158ad37d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf3d6e402158ad376 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.978728:0:14447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91edc3b89200/0xf3d6e402158ad37d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf3d6e402158ad376 expref: 19 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.978739:0:14447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91edc3b89200/0xf3d6e402158ad37d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf3d6e402158ad376 expref: 19 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.978749:0:14447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b89200, rc 0) 00000100:00100000:3.0:1789601626.978789:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:14451:x1876532880585728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601626.978795:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789601626.978871:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880585728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789601626.978887:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ad376 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad37d expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601626.978896:0:14451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ad376 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf3d6e402158ad37d expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601626.978960:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880585856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601626.978986:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601626.979001:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc5386c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601626.979015:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880585856 00000100:00100000:3.0:1789601626.979019:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880585856 00000100:00100000:3.0:1789601626.979048:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789601626.979055:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:14451:x1876532880585856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601626.979358:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:14451:x1876532880585856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601626.979365:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789601626.979398:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880585856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789601626.979428:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880585984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601626.979472:0:14451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601626.979486:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc5386c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601626.979498:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880585984 00000100:00100000:3.0:1789601626.979501:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880585984 00000100:00100000:3.0:1789601626.979522:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789601626.979528:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:14451:x1876532880585984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789601626.979709:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:14451:x1876532880585984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601626.979716:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789601626.979756:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:14451:1876532880585984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789601626.987568:0:16651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789601626.987829:0:14451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789601626.987918:0:14451:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789601626.987934:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ad376 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad37d expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601626.987950:0:14451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.130@tcp lock: ffff91edc3b89400/0xf3d6e402158ad376 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf3d6e402158ad37d expref: -99 pid: 14451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601627.403171:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601628.123297:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601628.123341:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601628.123385:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601628.123664:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858570240 00000100:00100000:3.0:1789601628.123679:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858570240 00000100:00100000:3.0:1789601628.123801:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:3.0:1789601628.123815:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:2359:x1876532858570240:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601628.123973:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:2359:x1876532858570240:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 161us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601628.123981:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:3.0:1789601628.124060:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601628.124170:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601628.124193:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601628.124213:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601628.124246:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858570112 00000100:00100000:3.0:1789601628.124251:0:14447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858570112 00000100:00100000:3.0:1789601628.124283:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 122 00000100:00100000:3.0:1789601628.124291:0:14447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+13:2358:x1876532858570112:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601628.124323:0:14447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:15f5cf11-52eb-460f-b02c-b9251b294d39+13:2358:x1876532858570112:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 33us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601628.124331:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 122 00000100:00100000:0.0:1789601628.124960:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858570496 00000100:00100000:0.0:1789601628.124968:0:15142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858570496 00000100:00100000:0.0:1789601628.124999:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858570752 00000100:00100000:0.0:1789601628.125002:0:15142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858570752 00000100:00100000:0.0:1789601628.125015:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858570368 00000100:00100000:0.0:1789601628.125018:0:15142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858570368 00000100:00100000:0.0:1789601628.125032:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858570880 00000100:00100000:0.0:1789601628.125035:0:15142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858570880 00000100:00100000:0.0:1789601628.125050:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:0.0:1789601628.125058:0:15142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+5:2359:x1876532858570496:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601628.125110:0:15142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+5:2359:x1876532858570496:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 53us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601628.125117:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:0.0:1789601628.125148:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:0.0:1789601628.125154:0:15142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6328b6e-fdda-4b75-9930-1671a349afd2+5:2359:x1876532858570752:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601628.125181:0:15142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6328b6e-fdda-4b75-9930-1671a349afd2+5:2359:x1876532858570752:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 27us (1795us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601628.125186:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:0.0:1789601628.125197:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:0.0:1789601628.125202:0:15142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+5:2358:x1876532858570368:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601628.125301:0:15142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+5:2358:x1876532858570368:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 96us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601628.125307:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:0.0:1789601628.125320:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1789601628.125327:0:15142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6328b6e-fdda-4b75-9930-1671a349afd2+5:2358:x1876532858570880:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601628.125352:0:15142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6328b6e-fdda-4b75-9930-1671a349afd2+5:2358:x1876532858570880:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 26us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601628.125358:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00080000:1.0:1789601628.125625:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789601628.125638:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789601628.125642:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601628.125670:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858570624 00000100:00100000:1.0:1789601628.125675:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858570624 00000100:00100000:1.0:1789601628.125726:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:1.0:1789601628.125735:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6328b6e-fdda-4b75-9930-1671a349afd2+6:2358:x1876532858570624:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:1.0:1789601628.125769:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6328b6e-fdda-4b75-9930-1671a349afd2+6:2358:x1876532858570624:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 36us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601628.125776:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00080000:1.0:1789601628.125796:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789601628.432932:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601628.823134:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601628.823262:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858571008 00000100:00100000:3.0:1789601628.823277:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858571008 00000100:00100000:3.0:1789601628.823355:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:3.0:1789601628.823368:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:14429:x1876532858571008:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789601628.823395:0:16328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601628.823427:0:16328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad384 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50614bf expref: -99 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.823531:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88800/0xf3d6e402158ad38b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.823550:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88800/0xf3d6e402158ad38b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.823773:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88800/0xf3d6e402158ad38b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.823794:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ad392 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.823823:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ad392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.823831:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ad392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.824272:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89a00/0xf3d6e402158ad399 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.824282:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89a00/0xf3d6e402158ad399 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.824290:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89a00/0xf3d6e402158ad399 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601628.824323:0:16328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789601628.824327:0:16328:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789601628.824374:0:16328:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89a00/0xf3d6e402158ad399 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.824388:0:16328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88800/0xf3d6e402158ad38b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.824395:0:16328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88800/0xf3d6e402158ad38b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.824403:0:16328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88800/0xf3d6e402158ad38b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.824410:0:16328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601628.824416:0:16328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88800/0xf3d6e402158ad38b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.824432:0:16328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88800/0xf3d6e402158ad38b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.824448:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd80dda00) 00010000:00010000:3.0:1789601628.824451:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601628.824458:0:16328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88800/0xf3d6e402158ad38b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.824464:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88800/0xf3d6e402158ad38b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.824480:0:16328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ad392 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.824486:0:16328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ad392 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.824492:0:16328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ad392 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.824497:0:16328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88a00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601628.824500:0:16328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ad392 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.824506:0:16328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ad392 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.824514:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff91edd9174200) 00010000:00010000:3.0:1789601628.824516:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601628.824519:0:16328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ad392 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.824536:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ad392 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.825853:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad384 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614bf expref: 8 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.825896:0:16328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89a00/0xf3d6e402158ad399 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614bf expref: 7 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.825905:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91edd9174a00) 00010000:00010000:3.0:1789601628.825908:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601628.825911:0:16328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b89a00, rc 0) 00000100:00100000:3.0:1789601628.826007:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+7:14429:x1876532858571008:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 2641us (2887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601628.826015:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 15 00000100:00100000:3.0:1789601628.838076:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601628.838210:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858571264 00000100:00100000:1.0:1789601628.838224:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858571264 00000100:00100000:1.0:1789601628.838308:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:1.0:1789601628.838322:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+7:14429:x1876532858571264:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789601628.838352:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601628.838382:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158ad3a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50614c6 expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.838502:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3a7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.838520:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.838533:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.838697:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.838739:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.838766:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.839206:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ad3b5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.839217:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ad3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.839224:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ad3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601628.839235:0:14456:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789601628.839450:0:14456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.839457:0:14456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3a7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.839464:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.839470:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601628.839475:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.839482:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3a7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.839505:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91edd9174a00) 00010000:00010000:1.0:1789601628.839508:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601628.839512:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.839518:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.839531:0:14456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.839537:0:14456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ae lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.839542:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.839546:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601628.839549:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.839555:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ae lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.839563:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91edd35e8100) 00010000:00010000:1.0:1789601628.839565:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601628.839568:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ae lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.839573:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.840097:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158ad3a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614c6 expref: 10 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.840114:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5c00/0xf3d6e402158ad3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614c6 expref: 9 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.840122:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91edd35e8a00) 00010000:00010000:1.0:1789601628.840125:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601628.840127:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c5c00, rc 0) 00000100:00100000:1.0:1789601628.840198:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+9:14429:x1876532858571264:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 1879us (2138us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789601628.840207:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1789601628.848129:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601628.851342:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858571392 00000100:00100000:1.0:1789601628.851358:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858571392 00000100:00100000:1.0:1789601628.851428:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:1.0:1789601628.851439:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+9:14429:x1876532858571392:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789601628.851550:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+9:14429:x1876532858571392:12345-192.168.201.30@tcp:59:lhsmtool_posix.0 Request processed in 113us (3437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601628.851558:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:0.0:1789601628.890107:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601628.894652:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858571520 00000100:00100000:1.0:1789601628.894677:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858571520 00000100:00100000:1.0:1789601628.894791:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:1.0:1789601628.894804:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+9:14435:x1876532858571520:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1789601628.895162:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601628.895191:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158ad3c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50614cd expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895299:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895316:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895330:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895348:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895355:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895362:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895628:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895636:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895643:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895648:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c4c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601628.895653:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895671:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895686:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd80dda00) 00010000:00010000:1.0:1789601628.895689:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601628.895695:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895702:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4c00/0xf3d6e402158ad3ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895718:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895725:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895730:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895735:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc29c5600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601628.895737:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895743:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895750:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91edd35e8100) 00010000:00010000:1.0:1789601628.895753:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601628.895756:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.895772:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5600/0xf3d6e402158ad3d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.896207:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158ad3c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614cd expref: 10 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.896221:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd80dda00) 00010000:00010000:1.0:1789601628.896224:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601628.896228:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c4a00/0xf3d6e402158ad3c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614cd expref: 10 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.896241:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc29c4a00, rc 0) 00000100:00100000:1.0:1789601628.896341:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+9:14435:x1876532858571520:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1540us (6244us total) trans 0 rc 301/301 00000100:00100000:1.0:1789601628.896350:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:0.0:1789601628.911074:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601628.911323:0:14463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858571648 00000100:00100000:3.0:1789601628.911336:0:14463:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858571648 00000100:00100000:3.0:1789601628.911410:0:14463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:3.0:1789601628.911422:0:14463:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9e82277c-40aa-4559-8a65-5f21a02d7d72+9:14435:x1876532858571648:12345-192.168.201.30@tcp:700:lfs.0 00000100:00100000:3.0:1789601628.911551:0:14463:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9e82277c-40aa-4559-8a65-5f21a02d7d72+9:14435:x1876532858571648:12345-192.168.201.30@tcp:700:lfs.0 Request processed in 131us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601628.911559:0:14463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:0.0:1789601628.918631:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601628.918743:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858571904 00000100:00100000:1.0:1789601628.918758:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858571904 00000100:00100000:1.0:1789601628.918870:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:1.0:1789601628.918890:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+9:14435:x1876532858571904:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:1.0:1789601628.918970:0:14455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601628.919005:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ad306 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061448 expref: 9 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.919030:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd80dda00) 00010000:00010000:1.0:1789601628.919037:0:14455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789601628.919324:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ad3d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.919346:0:14455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5800/0xf3d6e402158ad33e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614aa expref: 5 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.919355:0:14455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ad3d8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.919393:0:14455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5800/0xf3d6e402158ad33e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614aa expref: 5 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601628.919410:0:14455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5800/0xf3d6e402158ad33e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614aa expref: 5 pid: 14455 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601628.920071:0:14455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edffa5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14455:1876532880586112:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789601628.921012:0:14455:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd8dcb180 going to sleep for 11 seconds 00000100:00100000:1.0:1789601628.926222:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601628.926482:0:14455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edffa5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14455:1876532880586112:192.168.201.30@tcp:104: 00010000:00010000:0.0:1789601628.926520:0:14455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ad3d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601628.926932:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858572032 00000100:00100000:3.0:1789601628.926946:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858572032 00010000:00010000:3.0:1789601628.926992:0:14441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5800/0xf3d6e402158ad33e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614aa expref: 6 pid: 14455 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601628.927040:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:3.0:1789601628.927048:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6328b6e-fdda-4b75-9930-1671a349afd2+6:2356:x1876532858572032:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601628.927066:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601628.927074:0:14441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5800/0xf3d6e402158ad33e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614aa expref: 6 pid: 14455 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.927087:0:14441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5800/0xf3d6e402158ad33e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614aa expref: 6 pid: 14455 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.927116:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc29c5800/0xf3d6e402158ad33e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614aa expref: 6 pid: 14455 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.927135:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd80dda00) 00010000:00010000:3.0:1789601628.927140:0:14441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ad3d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.927149:0:14441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ad3d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.927155:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ad3d8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601628.927183:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789601628.927214:0:14455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ad3d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601628.927224:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ad3d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601628.927259:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6328b6e-fdda-4b75-9930-1671a349afd2+5:2356:x1876532858572032:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 207us (1056us total) trans 0 rc 0/0 00010000:00010000:0.0:1789601628.927259:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ad3df lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601628.927277:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00010000:00010000:0.0:1789601628.927279:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ad3df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601628.927290:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ad3df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601628.934060:0:14455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789601628.934086:0:14455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ad3d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601628.934101:0:14455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ad3d8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601628.934109:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ad3d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601628.934116:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601628.934121:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ad3d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601628.934130:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ad3d8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601628.934164:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd80dda00) 00010000:00010000:0.0:1789601628.934168:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601628.934175:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ad3d8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601628.934182:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030e00/0xf3d6e402158ad3d8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789601628.934209:0:14455:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000554517cc reply state 00000000e56246f6 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ad3df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601628.934218:0:14455:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789601628.934361:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+10:14435:x1876532858571904:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 15468us (15740us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789601628.934372:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00010000:00010000:0.0:1789601628.942531:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ad3df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601628.942557:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ad3df lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601628.942566:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ad3df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601628.942574:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925400 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601628.942580:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ad3df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601628.942589:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ad3df lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601628.942630:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91edd80dd600) 00010000:00010000:0.0:1789601628.942633:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601628.942639:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ad3df lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601628.942646:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ad3df lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601629.044125:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601629.050371:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858572160 00000100:00100000:2.0:1789601629.050828:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858572160 00000100:00100000:3.0:1789601629.051301:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:3.0:1789601629.051336:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+9:14443:x1876532858572160:12345-192.168.201.30@tcp:101:lctl.0 00010000:00010000:3.0:1789601629.051370:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601629.051410:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad3e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50614d4 expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.051513:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ad3ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.051529:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ad3ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.051544:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ad3ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601629.051588:0:14456:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789601629.051592:0:14456:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789601629.051642:0:14456:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ad3ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.051671:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad3e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614d4 expref: 11 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.051694:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88a00/0xf3d6e402158ad3ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614d4 expref: 10 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.051704:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd9174200) 00010000:00010000:3.0:1789601629.051708:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601629.051712:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88a00, rc 0) 00000100:00100000:3.0:1789601629.051809:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+10:14443:x1876532858572160:12345-192.168.201.30@tcp:101:lctl.0 Request processed in 477us (7698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601629.051826:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:1.0:1789601629.079350:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601629.079582:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858572288 00000100:00100000:3.0:1789601629.079594:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858572288 00000100:00100000:3.0:1789601629.079717:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:3.0:1789601629.079727:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6328b6e-fdda-4b75-9930-1671a349afd2+5:14444:x1876532858572288:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601629.079752:0:16328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601629.079775:0:16328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad3f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50614db expref: -99 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.080015:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88800/0xf3d6e402158ad3fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.080029:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88800/0xf3d6e402158ad3fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.080041:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88800/0xf3d6e402158ad3fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601629.080089:0:16328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789601629.080093:0:16328:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789601629.080116:0:16328:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88800/0xf3d6e402158ad3fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.080140:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad3f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614db expref: 7 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.080163:0:16328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88800/0xf3d6e402158ad3fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614db expref: 6 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.080192:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd9174200) 00010000:00010000:3.0:1789601629.080206:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789601629.080210:0:16328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88800, rc 0) 00000100:00100000:3.0:1789601629.080287:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6328b6e-fdda-4b75-9930-1671a349afd2+6:14444:x1876532858572288:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 562us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601629.080294:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:0.0:1789601629.084076:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601629.084233:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858572416 00000100:00100000:1.0:1789601629.084244:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858572416 00000100:00100000:1.0:1789601629.084317:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:1.0:1789601629.084328:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6328b6e-fdda-4b75-9930-1671a349afd2+6:14444:x1876532858572416:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1789601629.084352:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601629.084374:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad402 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50614e2 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084452:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031400/0xf3d6e402158ad409 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084491:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031400/0xf3d6e402158ad409 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084505:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031400/0xf3d6e402158ad409 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084523:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030600/0xf3d6e402158ad410 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084530:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030600/0xf3d6e402158ad410 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084536:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030600/0xf3d6e402158ad410 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084652:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad417 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084659:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad417 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084666:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad417 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601629.084703:0:14454:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789601629.084707:0:14454:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789601629.084724:0:14454:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad417 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084735:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031400/0xf3d6e402158ad409 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084748:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031400/0xf3d6e402158ad409 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084752:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031400/0xf3d6e402158ad409 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084758:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0031400 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601629.084763:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031400/0xf3d6e402158ad409 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084772:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031400/0xf3d6e402158ad409 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084786:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd9174200) 00010000:00010000:1.0:1789601629.084789:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601629.084794:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031400/0xf3d6e402158ad409 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084930:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031400/0xf3d6e402158ad409 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084950:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030600/0xf3d6e402158ad410 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084956:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030600/0xf3d6e402158ad410 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084962:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030600/0xf3d6e402158ad410 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084966:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030600 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601629.084976:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030600/0xf3d6e402158ad410 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084983:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030600/0xf3d6e402158ad410 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.084991:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91edd35e8100) 00010000:00010000:1.0:1789601629.084994:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601629.084997:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030600/0xf3d6e402158ad410 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.085003:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030600/0xf3d6e402158ad410 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.085040:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad402 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614e2 expref: 8 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.085056:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad417 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614e2 expref: 7 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.085063:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91edd35e8b00) 00010000:00010000:1.0:1789601629.085066:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789601629.085068:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc0031800, rc 0) 00000100:00100000:1.0:1789601629.085138:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6328b6e-fdda-4b75-9930-1671a349afd2+7:14444:x1876532858572416:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 813us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601629.085144:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 22 00000100:00100000:1.0:1789601629.088855:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601629.089322:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858572672 00000100:00100000:0.0:1789601629.089336:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858572672 00000100:00100000:3.0:1789601629.089642:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:3.0:1789601629.089659:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6328b6e-fdda-4b75-9930-1671a349afd2+7:14444:x1876532858572672:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601629.089688:0:16328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601629.089719:0:16328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad41e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50614e9 expref: -99 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601629.089898:0:16328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789601629.090094:0:16328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad41e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614e9 expref: 9 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.090111:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd9174200) 00010000:00010000:3.0:1789601629.090114:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601629.090120:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad41e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614e9 expref: 9 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.090136:0:16328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88e00, rc 0) 00000100:00100000:3.0:1789601629.090236:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6328b6e-fdda-4b75-9930-1671a349afd2+8:14444:x1876532858572672:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 581us (1411us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1789601629.090244:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 23 00000100:00100000:0.0:1789601629.096191:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601629.096570:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858572928 00000100:00100000:3.0:1789601629.096584:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858572928 00000100:00100000:3.0:1789601629.096925:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 24 00000100:00100000:3.0:1789601629.096948:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6328b6e-fdda-4b75-9930-1671a349afd2+8:14444:x1876532858572928:12345-192.168.201.30@tcp:36:lfs.0 00010000:00010000:3.0:1789601629.097037:0:14456:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601629.097080:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad417 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614e2 expref: 8 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.097103:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91edd35e8b00) 00010000:00010000:3.0:1789601629.097118:0:14456:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601629.097149:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad42c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.097163:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad42c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.097175:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad42c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601629.097483:0:14456:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000002551350 reply state 00000000969e754b transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad42c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601629.097495:0:14456:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789601629.097504:0:14456:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789601629.097625:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6328b6e-fdda-4b75-9930-1671a349afd2+9:14444:x1876532858572928:12345-192.168.201.30@tcp:36:lfs.0 Request processed in 689us (1448us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789601629.097639:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 24 00010000:00010000:2.0:1789601629.099925:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad42c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.099959:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad42c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.099968:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad42c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.099975:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601629.099980:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad42c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.099990:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad42c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.100041:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91edd9174c00) 00010000:00010000:2.0:1789601629.100045:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789601629.100051:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad42c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.100058:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad42c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601629.100894:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601629.101155:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858573184 00000100:00100000:2.0:1789601629.101166:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858573184 00000100:00100000:0.0:1789601629.102223:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:0.0:1789601629.102245:0:14458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6328b6e-fdda-4b75-9930-1671a349afd2+8:14444:x1876532858573184:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:0.0:1789601629.102587:0:14458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6328b6e-fdda-4b75-9930-1671a349afd2+9:14444:x1876532858573184:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 350us (1701us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789601629.102595:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:1.0:1789601629.106512:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601629.106634:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858573440 00000100:00100000:3.0:1789601629.106649:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858573440 00000100:00100000:3.0:1789601629.106775:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:3.0:1789601629.106811:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6328b6e-fdda-4b75-9930-1671a349afd2+9:14444:x1876532858573440:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:3.0:1789601629.106914:0:16328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601629.106950:0:16328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ad433 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50614f0 expref: -99 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.107056:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad43a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.107352:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad43a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.107367:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad43a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.107387:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad441 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.107406:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad441 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.107414:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad441 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601629.107576:0:16328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789601629.107711:0:16328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad43a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.107720:0:16328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad43a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.107728:0:16328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad43a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.107753:0:16328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601629.107759:0:16328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad43a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.107769:0:16328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad43a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.107785:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd9174200) 00010000:00010000:3.0:1789601629.107788:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601629.107793:0:16328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad43a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.107800:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad43a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.107819:0:16328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad441 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.107825:0:16328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad441 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.107832:0:16328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad441 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.107929:0:16328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601629.107933:0:16328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad441 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.108134:0:16328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad441 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.108156:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91edd9174f00) 00010000:00010000:3.0:1789601629.108158:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601629.108161:0:16328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad441 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.108167:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad441 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.108308:0:16328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ad433 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614f0 expref: 11 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.108320:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd9174200) 00010000:00010000:3.0:1789601629.108323:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789601629.108327:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ad433 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614f0 expref: 11 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.108337:0:16328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88600, rc 0) 00000100:00100000:3.0:1789601629.108494:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6328b6e-fdda-4b75-9930-1671a349afd2+10:14444:x1876532858573440:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 1686us (1998us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1789601629.108505:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 25 00000100:00100000:1.0:1789601629.113668:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601629.113805:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858573568 00000100:00100000:0.0:1789601629.113820:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858573568 00000100:00100000:1.0:1789601629.114603:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:1.0:1789601629.114620:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6328b6e-fdda-4b75-9930-1671a349afd2+10:14444:x1876532858573568:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:1.0:1789601629.114654:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601629.114684:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031400/0xf3d6e402158ad44f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50614f7 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.114804:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031c00/0xf3d6e402158ad456 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.114822:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031c00/0xf3d6e402158ad456 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.114855:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031c00/0xf3d6e402158ad456 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601629.114900:0:14454:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789601629.114905:0:14454:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789601629.114930:0:14454:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031c00/0xf3d6e402158ad456 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.114971:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031400/0xf3d6e402158ad44f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614f7 expref: 12 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.115135:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031c00/0xf3d6e402158ad456 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614f7 expref: 11 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.115147:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91edd35e8100) 00010000:00010000:1.0:1789601629.115150:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789601629.115154:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc0031c00, rc 0) 00000100:00100000:1.0:1789601629.115387:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6328b6e-fdda-4b75-9930-1671a349afd2+11:14444:x1876532858573568:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 771us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601629.115500:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 26 00000100:00100000:1.0:1789601629.122802:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601629.122964:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858573696 00000100:00100000:2.0:1789601629.122979:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858573696 00000100:00100000:2.0:1789601629.123057:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:2.0:1789601629.123080:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6328b6e-fdda-4b75-9930-1671a349afd2+11:14444:x1876532858573696:12345-192.168.201.30@tcp:37:lfs.0 00000100:00100000:2.0:1789601629.131409:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6328b6e-fdda-4b75-9930-1671a349afd2+11:14444:x1876532858573696:12345-192.168.201.30@tcp:37:lfs.0 Request processed in 8313us (8603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601629.131430:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:1.0:1789601629.135811:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601629.135938:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858573952 00000100:00100000:3.0:1789601629.135962:0:14458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858573952 00000100:00100000:3.0:1789601629.136036:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:3.0:1789601629.136049:0:14458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9939850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6328b6e-fdda-4b75-9930-1671a349afd2+11:14444:x1876532858573952:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1789601629.136588:0:14458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9939850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b6328b6e-fdda-4b75-9930-1671a349afd2+12:14444:x1876532858573952:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 540us (792us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789601629.136598:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:1.0:1789601629.196635:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601629.196780:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858574080 00000100:00100000:0.0:1789601629.196795:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858574080 00000100:00100000:0.0:1789601629.196968:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:0.0:1789601629.196982:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+10:14450:x1876532858574080:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:0.0:1789601629.197014:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601629.197048:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ad45d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f50614fe expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197185:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ad464 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197218:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ad464 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197234:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ad464 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197254:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ad46b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197261:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ad46b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197269:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ad46b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197409:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ad472 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197418:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ad472 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197426:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ad472 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601629.197461:0:14455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789601629.197466:0:14455:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789601629.197514:0:14455:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ad472 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197540:0:14455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ad464 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197547:0:14455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ad464 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197554:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ad464 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197561:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924200 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601629.197566:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ad464 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197575:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ad464 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197589:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd9174200) 00010000:00010000:0.0:1789601629.197593:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601629.197598:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ad464 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197605:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924200/0xf3d6e402158ad464 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197622:0:14455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ad46b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197628:0:14455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ad46b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197633:0:14455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ad46b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197645:0:14455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601629.197648:0:14455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ad46b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197655:0:14455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ad46b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197664:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91edd80dd600) 00010000:00010000:0.0:1789601629.197667:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601629.197669:0:14455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ad46b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197676:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ad46b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197716:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ad45d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614fe expref: 12 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197732:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925400/0xf3d6e402158ad472 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614fe expref: 11 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.197739:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91edd35e8100) 00010000:00010000:0.0:1789601629.197741:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789601629.197744:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00925400, rc 0) 00000100:00100000:0.0:1789601629.197920:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+11:14450:x1876532858574080:12345-192.168.201.30@tcp:101:bash.0 Request processed in 859us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601629.197928:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 27 00000100:00100000:1.0:1789601629.203700:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601629.203796:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858574336 00000100:00100000:3.0:1789601629.203811:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858574336 00000100:00100000:3.0:1789601629.203934:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 28 00000100:00100000:3.0:1789601629.203947:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+11:14450:x1876532858574336:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789601629.203976:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601629.204015:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ad479 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061505 expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.204487:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad480 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.204509:0:14456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031c00/0xf3d6e402158ad456 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614f7 expref: 11 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.204520:0:14456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad480 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.204568:0:14456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031c00/0xf3d6e402158ad456 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614f7 expref: 11 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.204583:0:14456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031c00/0xf3d6e402158ad456 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614f7 expref: 11 pid: 14454 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601629.204600:0:14456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14456:1876532880586240:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789601629.204779:0:14456:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd038eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601629.208931:0:14456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14456:1876532880586240:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601629.208983:0:14456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad480 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601629.210471:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601629.210755:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858574464 00000100:00100000:0.0:1789601629.210783:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858574464 00010000:00010000:0.0:1789601629.210834:0:14439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031c00/0xf3d6e402158ad456 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614f7 expref: 12 pid: 14454 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601629.210938:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1789601629.210950:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6328b6e-fdda-4b75-9930-1671a349afd2+12:2357:x1876532858574464:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789601629.210972:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789601629.210980:0:14439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031c00/0xf3d6e402158ad456 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614f7 expref: 12 pid: 14454 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.211005:0:14439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031c00/0xf3d6e402158ad456 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614f7 expref: 12 pid: 14454 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.211034:0:14439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031c00/0xf3d6e402158ad456 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f50614f7 expref: 12 pid: 14454 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.211056:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91edd35e8100) 00010000:00010000:0.0:1789601629.211072:0:14439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad480 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.211085:0:14439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad480 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.211094:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad480 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.211128:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601629.211190:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b6328b6e-fdda-4b75-9930-1671a349afd2+11:2357:x1876532858574464:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 242us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601629.211219:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00010000:00010000:3.0:1789601629.211429:0:14456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad480 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.211439:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad480 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.211472:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad487 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.211483:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad487 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.211492:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad487 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.212471:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ad48e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.212486:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ad48e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.212495:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ad48e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601629.212508:0:14456:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789601629.212541:0:14456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad480 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.212548:0:14456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad480 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.212556:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad480 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.212571:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b89e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601629.212576:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad480 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.212585:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad480 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.212599:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91edd35e8100) 00010000:00010000:3.0:1789601629.212602:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601629.212606:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad480 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.212612:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad480 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601629.212627:0:14456:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003024513d reply state 000000001142e003 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad487 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601629.212635:0:14456:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789601629.212678:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ad479 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061505 expref: 14 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.212694:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ad48e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061505 expref: 13 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.212701:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91edd9174b00) 00010000:00010000:3.0:1789601629.212704:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789601629.212706:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b89000, rc 0) 00000100:00100000:3.0:1789601629.212775:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+14:14450:x1876532858574336:12345-192.168.201.30@tcp:101:bash.0 Request processed in 8832us (9092us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789601629.212789:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 28 00010000:00010000:0.0:1789601629.220725:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad487 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.220753:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad487 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.220763:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad487 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.220770:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88c00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601629.220777:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad487 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.220786:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad487 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.220808:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff91edd9174f00) 00010000:00010000:0.0:1789601629.220812:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789601629.220818:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad487 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.220825:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad487 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601629.233330:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601629.233494:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858574592 00000100:00100000:3.0:1789601629.233509:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858574592 00000100:00100000:3.0:1789601629.233587:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:3.0:1789601629.233601:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+13:14450:x1876532858574592:12345-192.168.201.30@tcp:101:bash.0 00010000:00010000:3.0:1789601629.233636:0:16328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601629.233668:0:16328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ad49c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506150c expref: -99 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.233764:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad4a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.233785:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.233800:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601629.233904:0:16328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789601629.233913:0:16328:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789601629.234047:0:16328:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.234064:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.234097:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ad49c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506150c expref: 15 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.234121:0:16328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad4a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506150c expref: 14 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.234155:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91edd9174b00) 00010000:00010000:2.0:1789601629.234159:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601629.234165:0:16328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b89e00, rc 0) 00000100:00100000:2.0:1789601629.234260:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+14:14450:x1876532858574592:12345-192.168.201.30@tcp:101:bash.0 Request processed in 661us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601629.234268:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 29 00000100:00100000:1.0:1789601629.239313:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601629.239560:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858574848 00000100:00100000:2.0:1789601629.239573:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858574848 00000100:00100000:2.0:1789601629.239644:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:2.0:1789601629.239657:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+14:14450:x1876532858574848:12345-192.168.201.30@tcp:35:bash.0 00000100:00100000:2.0:1789601629.240187:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+15:14450:x1876532858574848:12345-192.168.201.30@tcp:35:bash.0 Request processed in 531us (888us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789601629.240781:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000040:00080000:2.0:1789601629.259716:0:14486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789601629.352266:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601629.352387:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858575104 00000100:00100000:2.0:1789601629.352411:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858575104 00000100:00100000:2.0:1789601629.352489:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:2.0:1789601629.352502:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+15:14460:x1876532858575104:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:2.0:1789601629.352535:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601629.352562:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad4aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061513 expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601629.352683:0:14454:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789601629.352916:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad4aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061513 expref: 17 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.352958:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91edd9174200) 00010000:00010000:2.0:1789601629.352962:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789601629.352969:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad4aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061513 expref: 17 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.352989:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8c400, rc 0) 00000100:00100000:2.0:1789601629.353071:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+16:14460:x1876532858575104:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 572us (818us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789601629.353079:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 30 00000100:00100000:1.0:1789601629.358539:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601629.358653:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858575360 00000100:00100000:3.0:1789601629.358667:0:14458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858575360 00000100:00100000:3.0:1789601629.358776:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:3.0:1789601629.358788:0:14458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+16:14460:x1876532858575360:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:3.0:1789601629.359192:0:14458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+17:14460:x1876532858575360:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 406us (667us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789601629.359201:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:1.0:1789601629.392001:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601629.392210:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858575616 00000100:00100000:0.0:1789601629.392226:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858575616 00000100:00100000:0.0:1789601629.392308:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:0.0:1789601629.392322:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+17:14463:x1876532858575616:12345-192.168.201.30@tcp:101:lfs.0 00010000:00010000:0.0:1789601629.392359:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601629.392521:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ad4b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506151a expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.392664:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ad4bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.392682:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ad4bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.392697:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ad4bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601629.392710:0:14455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789601629.392923:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ad4b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506151a expref: 20 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.392950:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ad4bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506151a expref: 19 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.392960:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91edd9174b00) 00010000:00010000:0.0:1789601629.392963:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789601629.392968:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924c00, rc 0) 00000100:00100000:0.0:1789601629.393166:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+19:14463:x1876532858575616:12345-192.168.201.30@tcp:101:lfs.0 Request processed in 846us (1189us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789601629.393175:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:1.0:1789601629.397242:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601629.397986:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601629.398079:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858575872 00000100:00100000:3.0:1789601629.398110:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858575872 00000100:00100000:3.0:1789601629.398191:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:3.0:1789601629.398203:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+19:2356:x1876532858575872:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601629.398224:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601629.398256:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ad4bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506151a expref: 19 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.398281:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91edd9174b00) 00010000:00010000:3.0:1789601629.398288:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601629.398353:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+18:2356:x1876532858575872:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 152us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601629.398360:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:2.0:1789601629.400503:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858575744 00000100:00100000:2.0:1789601629.400526:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858575744 00000100:00100000:2.0:1789601629.400688:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:2.0:1789601629.400700:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+18:14463:x1876532858575744:12345-192.168.201.30@tcp:54:lfs.0 00010000:00010000:2.0:1789601629.400794:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad4cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.400815:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad4cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.400830:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad4cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.400900:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad4cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.400907:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad4cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.400936:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad4cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.400943:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c400 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601629.400948:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad4cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.400956:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad4cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.400971:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91edd9174b00) 00010000:00010000:2.0:1789601629.400975:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789601629.400982:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad4cd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.400989:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad4cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601629.401087:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+18:14463:x1876532858575744:12345-192.168.201.30@tcp:54:lfs.0 Request processed in 389us (3859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601629.401095:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:0.0:1789601629.403115:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601629.403295:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858576128 00000100:00100000:2.0:1789601629.403309:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858576128 00000100:00100000:2.0:1789601629.403407:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1789601629.403419:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+18:14463:x1876532858576128:12345-192.168.201.30@tcp:35:lfs.0 00000100:00100000:2.0:1789601629.403735:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+19:14463:x1876532858576128:12345-192.168.201.30@tcp:35:lfs.0 Request processed in 317us (632us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789601629.403743:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00010000:00010000:3.0:1789601629.449100:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601629.633278:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601629.633900:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858576384 00000100:00100000:2.0:1789601629.633916:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858576384 00000100:00100000:2.0:1789601629.634186:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:2.0:1789601629.634199:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf83bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+19:14494:x1876532858576384:12345-192.168.201.30@tcp:101:cat.0 00010000:00010000:2.0:1789601629.634234:0:16328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601629.634260:0:16328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad4d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061521 expref: -99 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.634910:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ad4db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.635014:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ad4db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.635032:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ad4db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789601629.635061:0:16328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789601629.635827:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad4d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061521 expref: 22 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.635905:0:16328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ad4db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061521 expref: 21 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.635915:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91edd9174b00) 00010000:00010000:2.0:1789601629.635918:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601629.635923:0:16328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8c800, rc 0) 00000100:00100000:2.0:1789601629.636289:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf83bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+21:14494:x1876532858576384:12345-192.168.201.30@tcp:101:cat.0 Request processed in 2090us (3023us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789601629.636324:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 33 00000100:00100000:1.0:1789601629.649192:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601629.649256:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601629.649322:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858576768 00000100:00100000:2.0:1789601629.649337:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858576768 00000100:00100000:0.0:1789601629.649349:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858576640 00000100:00100000:0.0:1789601629.649356:0:14458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858576640 00000100:00100000:0.0:1789601629.649453:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 8 00000100:00100000:0.0:1789601629.649482:0:14458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+22:14494:x1876532858576640:12345-192.168.201.30@tcp:35:cat.0 00000100:00100000:2.0:1789601629.649816:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:2.0:1789601629.649826:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+23:2357:x1876532858576768:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601629.649884:0:14440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601629.649920:0:14440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c800/0xf3d6e402158ad4db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061521 expref: 23 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601629.649999:0:14458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+23:14494:x1876532858576640:12345-192.168.201.30@tcp:35:cat.0 Request processed in 520us (819us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1789601629.650012:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 8 00010000:00010000:2.0:1789601629.650119:0:14440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91edd9174b00) 00010000:00010000:2.0:1789601629.650126:0:14440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601629.651768:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+21:2357:x1876532858576768:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 1928us (2495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601629.651787:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:1.0:1789601629.748667:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601629.748778:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858577024 00000100:00100000:3.0:1789601629.748792:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858577024 00000100:00100000:3.0:1789601629.748950:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:3.0:1789601629.748962:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+21:14500:x1876532858577024:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:3.0:1789601629.748994:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601629.749030:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ad4e9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061528 expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.749182:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad4f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.749200:0:14456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ad48e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061505 expref: 22 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.749228:0:14456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad4a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506150c expref: 22 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.749238:0:14456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad4f0 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.749282:0:14456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad4a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506150c expref: 22 pid: 16328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.749298:0:14456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad4a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506150c expref: 22 pid: 16328 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601629.749315:0:14456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14456:1876532880586368:192.168.201.30@tcp:104: 00010000:00010000:3.0:1789601629.749440:0:14456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ad48e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061505 expref: 22 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.749450:0:14456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ad48e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061505 expref: 22 pid: 14456 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601629.749460:0:14456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14456:1876532880586496:192.168.201.30@tcp:104: 00000100:00100000:3.0:1789601629.749485:0:14456:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edd038eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789601629.756494:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601629.756553:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601629.756597:0:14456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14456:1876532880586368:192.168.201.30@tcp:104: 00000100:00100000:1.0:1789601629.756615:0:14456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14456:1876532880586496:192.168.201.30@tcp:104: 00010000:00010000:1.0:1789601629.756663:0:14456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad4f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601629.756940:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858577152 00000100:00100000:2.0:1789601629.756952:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858577152 00000100:00100000:0.0:1789601629.756974:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858577280 00000100:00100000:0.0:1789601629.756981:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858577280 00010000:00010000:2.0:1789601629.757007:0:14441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad4a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506150c expref: 24 pid: 16328 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601629.757045:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:2.0:1789601629.757056:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf7ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+24:2357:x1876532858577152:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601629.757075:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601629.757082:0:14441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad4a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506150c expref: 24 pid: 16328 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.757095:0:14441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad4a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506150c expref: 24 pid: 16328 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.757119:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89e00/0xf3d6e402158ad4a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f506150c expref: 24 pid: 16328 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.757154:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91edd9174b00) 00010000:00010000:2.0:1789601629.757160:0:14441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad4f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.757170:0:14441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad4f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.757178:0:14439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ad48e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061505 expref: 23 pid: 14456 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.757180:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789601629.757206:0:14439:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789601629.757216:0:14439:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789601629.757250:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf7ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+23:2357:x1876532858577152:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 195us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601629.757257:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:2.0:1789601629.757315:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 12 00000100:00100000:2.0:1789601629.757323:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+22:2357:x1876532858577280:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789601629.757331:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789601629.757336:0:14441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ad48e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061505 expref: 22 pid: 14456 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.757348:0:14441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ad48e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061505 expref: 22 pid: 14456 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.757362:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b89000/0xf3d6e402158ad48e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061505 expref: 22 pid: 14456 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.757373:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91edd9174b00) 00010000:00010000:2.0:1789601629.757377:0:14441:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad4f0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.757396:0:14441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad4f0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.757406:0:14441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad4f0 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.757440:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789601629.757468:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+21:2357:x1876532858577280:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 146us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601629.757475:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 12 00010000:00010000:0.0:1789601629.757801:0:14456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad4f0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.757811:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad4f0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601629.757892:0:14456:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789601629.758355:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88600/0xf3d6e402158ad4e9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061528 expref: 22 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.758378:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88c00/0xf3d6e402158ad4f0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061528 expref: 21 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.758387:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91edd9174b00) 00010000:00010000:0.0:1789601629.758390:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789601629.758394:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88c00, rc 0) 00000100:00100000:0.0:1789601629.758449:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+21:14500:x1876532858577024:12345-192.168.201.30@tcp:101:dd.0 Request processed in 9489us (9797us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1789601629.758472:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 34 00000100:00100000:0.0:1789601629.767503:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601629.767565:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858577536 00000100:00100000:1.0:1789601629.767578:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858577536 00000100:00100000:1.0:1789601629.767654:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 35 00000100:00100000:1.0:1789601629.767666:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+21:14500:x1876532858577536:12345-192.168.201.30@tcp:36:dd.0 00010000:00010000:1.0:1789601629.768442:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad4fe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.768484:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad4fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.768499:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad4fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789601629.768563:0:14455:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1789601629.768596:0:14455:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cfa746bb reply state 000000008222694f transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad4fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601629.768608:0:14455:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789601629.769959:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+24:14500:x1876532858577536:12345-192.168.201.30@tcp:36:dd.0 Request processed in 2043us (2222us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1789601629.769974:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 35 00000020:00080000:1.0:1789601629.769982:0:14455:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789601629.773704:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601629.773801:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858577664 00010000:00010000:2.0:1789601629.774763:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad4fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.774786:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad4fe lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.774796:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad4fe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.774804:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030a00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601629.774811:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad4fe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.775053:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad4fe lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.775078:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91edd9174b00) 00010000:00010000:2.0:1789601629.775081:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601629.775088:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad4fe lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.775180:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad4fe lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601629.775974:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858577664 00000100:00100000:1.0:1789601629.776136:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:1.0:1789601629.776151:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+23:14500:x1876532858577664:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:1.0:1789601629.776185:0:14454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789601629.776211:0:14454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad505 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506152f expref: -99 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.776289:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad505 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506152f expref: 24 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.776307:0:14454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad505 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506152f expref: 24 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601629.776349:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91edd9174b00) 00010000:00010000:1.0:1789601629.776353:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789601629.776357:0:14454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc0031800, rc 0) 00000100:00100000:1.0:1789601629.776446:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+24:14500:x1876532858577664:12345-192.168.201.30@tcp:101:dd.0 Request processed in 299us (2759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601629.776453:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 36 00000100:00100000:2.0:1789601629.794449:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601629.794756:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858577920 00000100:00100000:3.0:1789601629.794790:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858577920 00000100:00100000:3.0:1789601629.794938:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:3.0:1789601629.794950:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+24:14500:x1876532858577920:12345-192.168.201.30@tcp:103:dd.0 00010000:00010000:3.0:1789601629.794970:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601629.795143:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad505 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506152f expref: 24 pid: 14454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601629.795170:0:14441:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91edd9174b00) 00010000:00010000:3.0:1789601629.795176:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601629.795251:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+23:14500:x1876532858577920:12345-192.168.201.30@tcp:103:dd.0 Request processed in 304us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601629.795259:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:0.0:1789601629.805078:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601629.805492:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858578048 00000100:00100000:2.0:1789601629.805507:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858578048 00000100:00100000:2.0:1789601629.805732:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:2.0:1789601629.805745:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+23:14500:x1876532858578048:12345-192.168.201.30@tcp:58:dd.0 00010000:00010000:2.0:1789601629.805924:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ad50c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.805958:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ad50c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601629.805973:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ad50c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789601629.809750:0:16328:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789601629.810015:0:16328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789601629.810090:0:16328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789601629.810250:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+23:14500:x1876532858578048:12345-192.168.201.30@tcp:58:dd.0 Request processed in 4501us (5182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601629.810262:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 37 00000100:00100000:1.0:1789601629.813717:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601629.813802:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858578176 00000100:00100000:0.0:1789601629.813816:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858578176 00000100:00100000:0.0:1789601629.813948:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:0.0:1789601629.813961:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+23:14500:x1876532858578176:12345-192.168.201.30@tcp:101:dd.0 00010000:00010000:0.0:1789601629.813988:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601629.814016:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ad513 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061536 expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.814093:0:14456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ad50c lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.814106:0:14456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ad513 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061536 expref: 24 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.814131:0:14456:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ad50c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.814146:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ad513 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061536 expref: 24 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.814162:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91edd9174b00) 00010000:00010000:0.0:1789601629.814166:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789601629.814170:0:14456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ad513 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061536 expref: 24 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601629.814201:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00925000, rc 0) 00000100:00100000:0.0:1789601629.814289:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+24:14500:x1876532858578176:12345-192.168.201.30@tcp:101:dd.0 Request processed in 331us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601629.814296:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 38 00000100:00100000:3.0:1789601630.154691:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601630.154727:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880586624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789601630.154822:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601630.154954:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880586624 00000100:00100000:3.0:1789601630.154964:0:15144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880586624 00000100:00100000:3.0:1789601630.155056:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789601630.155384:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789601630.156194:0:15144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880586624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789601630.156242:0:15144:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789601630.156332:0:15144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3317:x1876532880586624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1266us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601630.156341:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789601630.159916:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3317:1876532880586624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789601630.161610:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3319:1876532880586752:0@lo:400:kworker.0 00000100:00100000:2.0:1789601630.161786:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601630.161898:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880586752 00000100:00100000:2.0:1789601630.161908:0:14449:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880586752 00000100:00100000:2.0:1789601630.161956:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789601630.161964:0:14449:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:3319:x1876532880586752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601630.162026:0:14449:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c+19:3319:x1876532880586752:12345-0@lo:400:kworker.0 Request processed in 62us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601630.162034:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789601630.162078:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ab485b1a-a7bb-4d29-b5ee-d88511e5dd0c:3319:1876532880586752:0@lo:400:kworker.0 00000100:00100000:2.0:1789601630.162113:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880586880:0@lo:400:kworker.0 00000100:00100000:2.0:1789601630.162144:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789601630.162179:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880586880 00000100:00100000:2.0:1789601630.162183:0:15142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880586880 00000100:00100000:2.0:1789601630.162221:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789601630.162226:0:15142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880586880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601630.162254:0:15142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880586880:12345-0@lo:400:kworker.0 Request processed in 28us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601630.162258:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789601630.162879:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789601630.162925:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880587008:0@lo:400:kworker.0 00000100:00100000:3.0:1789601630.162978:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601630.163022:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880587008 00000100:00100000:3.0:1789601630.163027:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880587008 00000100:00100000:2.0:1789601630.164073:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880586880:0@lo:400:kworker.0 00000100:00100000:2.0:1789601630.164157:0:3317:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789601630.164162:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789601630.164169:0:3317:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880587136:0@lo:400:kworker.0 00000100:00100000:3.0:1789601630.164182:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880587008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789601630.164229:0:3317:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601630.164260:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3317:x1876532880587008:12345-0@lo:400:kworker.0 Request processed in 84us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601630.164287:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3317:1876532880587008:0@lo:400:kworker.0 00000100:00100000:2.0:1789601630.164333:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876532880587264:0@lo:400:kworker.0 00000100:00100000:2.0:1789601630.164365:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601630.166768:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789601630.168573:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880587136 00000100:00100000:3.0:1789601630.168594:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880587136 00000100:00100000:1.0:1789601630.169896:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880587264 00000100:00100000:1.0:1789601630.169912:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880587264 00000100:00100000:0.0:1789601630.170301:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789601630.170516:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880587136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601630.170786:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3317:x1876532880587136:12345-0@lo:400:kworker.0 Request processed in 473us (6556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601630.170795:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789601630.170822:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789601630.170829:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876532880587264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789601630.170887:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1876532880587264:12345-0@lo:400:kworker.0 Request processed in 60us (6522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601630.170894:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789601630.171722:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3319:1876532880587264:0@lo:400:kworker.0 00000100:00100000:0.0:1789601630.171763:0:3317:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3317:1876532880587136:0@lo:400:kworker.0 00000100:00080000:2.0:1789601630.171880:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:2.0:1789601630.229614:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:2.0:1789601630.229641:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:2.0:1789601630.229756:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:2.0:1789601630.230089:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:2.0:1789601630.281249:0:14486:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789601630.281260:0:14486:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789601630.281324:0:14486:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789601630.281334:0:14486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789601630.281489:0:14486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00c82680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14486:1876532880587392:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789601630.281621:0:14486:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8dbfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789601630.286541:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601630.287930:0:14486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00c82680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14486:1876532880587392:192.168.201.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789601630.290474:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858578304 00000100:00100000:2.0:1789601630.290491:0:14465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858578304 00000100:00100000:2.0:1789601630.290642:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:2.0:1789601630.290656:0:14465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9e82277c-40aa-4559-8a65-5f21a02d7d72+11:14501:x1876532858578304:12345-192.168.201.30@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789601630.290784:0:14465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9e82277c-40aa-4559-8a65-5f21a02d7d72+11:14501:x1876532858578304:12345-192.168.201.30@tcp:900:lhsmtool_posix.0 Request processed in 130us (4270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601630.290793:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00080000:3.0:1789601630.291601:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601630.293994:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601630.294085:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858578432 00000100:00100000:3.0:1789601630.294098:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858578432 00000100:00100000:3.0:1789601630.294170:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:3.0:1789601630.294182:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+11:14501:x1876532858578432:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789601630.294226:0:14455:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789601630.294417:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+11:14501:x1876532858578432:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 238us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601630.294423:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 39 00000100:00100000:0.0:1789601630.302509:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601630.302727:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858578560 00000100:00100000:1.0:1789601630.302740:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858578560 00000100:00100000:1.0:1789601630.302815:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:1.0:1789601630.302828:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+11:14501:x1876532858578560:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789601630.303388:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad51a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303412:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad51a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303429:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad51a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303639:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad521 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303666:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad521 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303696:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad521 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303729:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031000/0xf3d6e402158ad528 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303738:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031000/0xf3d6e402158ad528 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303758:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031000/0xf3d6e402158ad528 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789601630.303802:0:16328:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789601630.303807:0:16328:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789601630.303820:0:16328:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031000/0xf3d6e402158ad528 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303832:0:16328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad51a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303890:0:16328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad51a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303898:0:16328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad51a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303904:0:16328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0031800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601630.303908:0:16328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad51a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303916:0:16328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad51a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303934:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91edd35e8a00) 00010000:00010000:1.0:1789601630.303937:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601630.303942:0:16328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad51a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303948:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad51a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303966:0:16328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad521 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303972:0:16328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad521 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303978:0:16328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad521 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303983:0:16328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030a00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601630.303985:0:16328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad521 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303991:0:16328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad521 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.303998:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff91edd35e8300) 00010000:00010000:1.0:1789601630.304000:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601630.304003:0:16328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad521 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.304011:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad521 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.304042:0:16328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031000/0xf3d6e402158ad528 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.304048:0:16328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031000/0xf3d6e402158ad528 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.304054:0:16328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031000/0xf3d6e402158ad528 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.304058:0:16328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0031000 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601630.304061:0:16328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031000/0xf3d6e402158ad528 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.304068:0:16328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031000/0xf3d6e402158ad528 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.304075:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91edd9174b00) 00010000:00010000:1.0:1789601630.304078:0:16328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601630.304081:0:16328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031000/0xf3d6e402158ad528 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.304087:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031000/0xf3d6e402158ad528 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601630.304190:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+11:14501:x1876532858578560:12345-192.168.201.30@tcp:34:lhsmtool_posix.0 Request processed in 1360us (1692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601630.304200:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 40 00000100:00100000:1.0:1789601630.310327:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601630.310448:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858578816 00000100:00100000:3.0:1789601630.310465:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858578816 00000100:00100000:0.0:1789601630.310634:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:0.0:1789601630.310650:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ecc2c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+11:14501:x1876532858578816:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601630.310681:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601630.310710:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ad52f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506153d expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.311985:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ad536 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.312009:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ad536 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.312517:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ad536 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789601630.312540:0:14456:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789601630.312822:0:14456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ad536 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.312830:0:14456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ad536 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.312886:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ad536 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.312894:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601630.312901:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ad536 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.312910:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ad536 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.312926:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91edd9174b00) 00010000:00010000:0.0:1789601630.312929:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789601630.312934:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ad536 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.312959:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ad536 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.313020:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ad52f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506153d expref: 13 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.313294:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91edd35e8a00) 00010000:00010000:0.0:1789601630.313297:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789601630.313302:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924400/0xf3d6e402158ad52f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506153d expref: 13 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.313314:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924400, rc 0) 00000100:00100000:0.0:1789601630.313402:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ecc2c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+12:14501:x1876532858578816:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 2754us (3081us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1789601630.313412:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 41 00000100:00100000:2.0:1789601630.316814:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601630.316915:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858578944 00000100:00100000:1.0:1789601630.316934:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858578944 00000100:00100000:1.0:1789601630.317029:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:1.0:1789601630.317041:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+12:14501:x1876532858578944:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789601630.317084:0:14454:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789601630.317207:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+12:14501:x1876532858578944:12345-192.168.201.30@tcp:53:lhsmtool_posix.0 Request processed in 167us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601630.317215:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 42 00000100:00100000:2.0:1789601630.325035:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601630.325933:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858579200 00000100:00100000:3.0:1789601630.325955:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858579200 00000100:00100000:2.0:1789601630.326174:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:2.0:1789601630.326189:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+12:14501:x1876532858579200:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601630.326211:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601630.326245:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ad544 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061544 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789601630.327528:0:14455:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:2.0:1789601630.327540:0:14455:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1789601630.327595:0:14455:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1789601630.327952:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ad54b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.327973:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ad54b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.327986:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ad54b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.328047:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c000/0xf3d6e402158ad544 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061544 expref: 15 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.328066:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ad54b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061544 expref: 14 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.328075:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91edd8a67600) 00010000:00010000:2.0:1789601630.328078:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789601630.328081:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8dc00, rc 0) 00000100:00100000:2.0:1789601630.328147:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00c83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+14:14501:x1876532858579200:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 1962us (3121us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1789601630.328156:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 43 00000100:00100000:3.0:1789601630.336055:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601630.336185:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858579456 00000100:00100000:1.0:1789601630.336201:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858579456 00000100:00100000:1.0:1789601630.336279:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:1.0:1789601630.336291:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+14:14501:x1876532858579456:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789601630.336354:0:14454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601630.336380:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8dc00/0xf3d6e402158ad54b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061544 expref: 14 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.336403:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91edd8a67600) 00010000:00010000:1.0:1789601630.336413:0:14454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789601630.336437:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad559 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.336451:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad559 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.336461:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad559 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.336522:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad560 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x92657077 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.336531:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad560 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92657077 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.336555:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad560 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92657077 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.336774:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad559 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.336783:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad559 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.336791:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad559 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.336796:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030a00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601630.336801:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad559 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.336807:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad559 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.336816:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91edd35e8100) 00010000:00010000:1.0:1789601630.336820:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601630.336823:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad559 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.336829:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030a00/0xf3d6e402158ad559 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.336915:0:14454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad560 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92657077 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.336922:0:14454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad560 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92657077 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.336934:0:14454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad560 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92657077 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.336940:0:14454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0031800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:1.0:1789601630.336943:0:14454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad560 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92657077 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.336949:0:14454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad560 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x92657077 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.336957:0:14454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x92657077 (ffff91edd35e8300) 00010000:00010000:1.0:1789601630.336959:0:14454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789601630.336962:0:14454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad560 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x92657077 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.337081:0:14454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad560 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x92657077 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601630.337234:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+13:14501:x1876532858579456:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 944us (1192us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789601630.337242:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 44 00000100:00100000:1.0:1789601630.348741:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601630.348907:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858579584 00000100:00100000:0.0:1789601630.348925:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858579584 00000100:00100000:0.0:1789601630.349011:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:0.0:1789601630.349022:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+13:14501:x1876532858579584:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601630.349044:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601630.349069:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ad567 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f506154b expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.349107:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ad56e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.349119:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ad56e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.349146:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ad56e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.349251:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924800/0xf3d6e402158ad567 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506154b expref: 15 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.349272:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00924c00/0xf3d6e402158ad56e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f506154b expref: 14 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.349281:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91edd80dd700) 00010000:00010000:0.0:1789601630.349285:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789601630.349288:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924c00, rc 0) 00000100:00100000:0.0:1789601630.349355:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+14:14501:x1876532858579584:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 334us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601630.349363:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 45 00000100:00100000:0.0:1789601630.355030:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601630.355121:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858579840 00000100:00100000:1.0:1789601630.355132:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858579840 00000100:00100000:1.0:1789601630.355186:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:1.0:1789601630.355196:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+14:14501:x1876532858579840:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789601630.355279:0:14454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad575 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.355314:0:14454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad575 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.355327:0:14454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad575 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789601630.355912:0:14454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1789601630.355924:0:14454:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 500394085951ns, next at 501394083741ns, rc = 0 00000004:00010000:1.0:1789601630.356011:0:14454:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8f50831 reply state 000000005d8021fd transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad575 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601630.356020:0:14454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789601630.356127:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+16:14501:x1876532858579840:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 930us (1105us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789601630.356135:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 46 00000100:00100000:1.0:1789601630.361248:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00010000:00010000:0.0:1789601630.361262:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad575 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.361284:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad575 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.361294:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad575 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.361302:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0031800 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:0.0:1789601630.361310:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad575 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.361347:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad575 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.361368:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91edd80dd700) 00010000:00010000:0.0:1789601630.361372:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789601630.361378:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad575 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.361384:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0031800/0xf3d6e402158ad575 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14454 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601630.361403:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858579968 00000100:00100000:2.0:1789601630.361418:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858579968 00000100:00100000:2.0:1789601630.361521:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:2.0:1789601630.361761:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+15:14501:x1876532858579968:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789601630.361794:0:14456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789601630.361819:0:14456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ad57c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061552 expref: -99 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.361951:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ad57c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061552 expref: 16 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.362150:0:14456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ad57c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061552 expref: 16 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.362174:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91edd80dd700) 00010000:00010000:2.0:1789601630.362177:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789601630.362181:0:14456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edd8d8d600, rc 0) 00000100:00100000:2.0:1789601630.362259:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+16:14501:x1876532858579968:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 503us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601630.362267:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 47 00000100:00100000:2.0:1789601630.367095:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601630.367318:0:16106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858580096 00000100:00100000:1.0:1789601630.367332:0:16106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858580096 00000100:00100000:1.0:1789601630.367425:0:16106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:1.0:1789601630.367438:0:16106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+5:2359:x1876532858580096:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789601630.367752:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789601630.370693:0:16106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:2359:x1876532858580096:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 3240us (3596us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789601630.370712:0:16106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:0.0:1789601630.374561:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601630.374673:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858580352 00000100:00100000:1.0:1789601630.374692:0:14457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858580352 00000100:00100000:1.0:1789601630.374894:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:1.0:1789601630.374910:0:14457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+16:14501:x1876532858580352:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789601630.375442:0:14457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+17:14501:x1876532858580352:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 534us (890us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1789601630.375451:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 9 00000100:00100000:2.0:1789601630.378519:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601630.378645:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858580608 00000100:00100000:3.0:1789601630.378659:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858580608 00000100:00100000:3.0:1789601630.378757:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:3.0:1789601630.378769:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+17:14501:x1876532858580608:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789601630.378991:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+17:14501:x1876532858580608:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 223us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601630.379000:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 48 00000100:00100000:2.0:1789601630.383211:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601630.383902:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858580736 00000100:00100000:3.0:1789601630.383930:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858580736 00000100:00100000:3.0:1789601630.384025:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:3.0:1789601630.384039:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edffa5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+17:14501:x1876532858580736:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789601630.384066:0:14455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789601630.384092:0:14455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad583 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061559 expref: -99 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.384185:0:14455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88400/0xf3d6e402158ad58a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.384203:0:14455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88400/0xf3d6e402158ad58a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.384217:0:14455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88400/0xf3d6e402158ad58a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789601630.384267:0:14455:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789601630.384292:0:14455:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88400/0xf3d6e402158ad58a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.384328:0:14455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad583 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061559 expref: 19 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.384378:0:14455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88400/0xf3d6e402158ad58a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061559 expref: 18 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.384389:0:14455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91edd80dd700) 00010000:00010000:3.0:1789601630.384393:0:14455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789601630.384398:0:14455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91edc3b88400, rc 0) 00000100:00100000:3.0:1789601630.384494:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edffa5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+18:14501:x1876532858580736:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 458us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601630.384503:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 49 00000100:00100000:3.0:1789601630.389166:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601630.389287:0:15142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858580864 00000100:00100000:0.0:1789601630.389302:0:15142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858580864 00000100:00100000:0.0:1789601630.389380:0:15142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:0.0:1789601630.389394:0:15142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:2358:x1876532858580864:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789601630.389419:0:15142:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789601630.389450:0:15142:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad591 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfba567d4f5061560 expref: -99 pid: 15142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789601630.389487:0:15142:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab275f, blocks: 0x1 00010000:00010000:0.0:1789601630.389515:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=500s v=(0 0) 00010000:00010000:0.0:1789601630.389521:0:15142:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601630.389532:0:15142:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad591 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061560 expref: 7 pid: 15142 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.389555:0:15142:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad591 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061560 expref: 7 pid: 15142 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.389597:0:15142:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91ee00924800, rc 0) 00000100:00100000:0.0:1789601630.389680:0:15142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+7:2358:x1876532858580864:12345-192.168.201.30@tcp:101:lhsmtool_posix.0 Request processed in 289us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601630.389688:0:15142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:0.0:1789601630.393769:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601630.393952:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858581120 00000100:00100000:3.0:1789601630.393966:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858581120 00000100:00100000:3.0:1789601630.394048:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:3.0:1789601630.394061:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+18:14501:x1876532858581120:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789601630.394197:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+18:14501:x1876532858581120:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 138us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601630.394205:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 50 00000100:00100000:1.0:1789601630.399311:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601630.399478:0:14455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858581248 00000100:00100000:3.0:1789601630.399492:0:14455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858581248 00000100:00100000:3.0:1789601630.399760:0:14455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:3.0:1789601630.399773:0:14455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+18:14501:x1876532858581248:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789601630.444212:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:2.0:1789601630.444249:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1789601630.444258:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1789601630.444484:0:14455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+14:14501:x1876532858581248:12345-192.168.201.30@tcp:44:lhsmtool_posix.0 Request processed in 44704us (45177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601630.444497:0:14455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 51 00000100:00100000:0.0:1789601630.444973:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91edf8b19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880587520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789601630.445041:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601630.445128:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880587520 00000100:00100000:0.0:1789601630.445137:0:15140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880587520 00000100:00100000:0.0:1789601630.445186:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789601630.445195:0:15140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1876532880587520:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789601630.445388:0:15140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789601630.445393:0:15140:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789601630.445396:0:15140:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789601630.445398:0:15140:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789601631 -> 1789601631 00002000:00010000:0.0:1789601630.445401:0:15140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789601630.445437:0:15140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1876532880587520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 243us (395us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789601630.445445:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789601630.448314:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000004:00080000:0.0:1789601630.448404:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91edf8b19880/2, rc 0, transno 8589934595 00000100:00100000:0.0:1789601630.448416:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91edf8b19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3320:1876532880587520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789601630.448458:0:16106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858581376 00000100:00100000:0.0:1789601630.448470:0:16106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858581376 00000100:00100000:0.0:1789601630.448545:0:16106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1789601630.448576:0:16106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+7:2359:x1876532858581376:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789601630.448728:0:16106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+7:2359:x1876532858581376:12345-192.168.201.30@tcp:16:lhsmtool_posix.0 Request processed in 154us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601630.448737:0:16106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 16 00000100:00100000:0.0:1789601630.452117:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601630.452233:0:16328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858581632 00000100:00100000:3.0:1789601630.452248:0:16328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858581632 00000100:00100000:3.0:1789601630.452377:0:16328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 52 00000100:00100000:3.0:1789601630.452401:0:16328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+14:14501:x1876532858581632:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789601630.452493:0:16328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601630.452667:0:16328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88400/0xf3d6e402158ad58a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061559 expref: 14 pid: 14455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.452694:0:16328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91edd80dd700) 00010000:00010000:3.0:1789601630.452701:0:16328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789601630.452743:0:16328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad598 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.452760:0:16328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad598 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.452773:0:16328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad598 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789601630.453191:0:16328:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009bf67fb0 reply state 00000000cf27bc85 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad598 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601630.453202:0:16328:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789601630.453346:0:16328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+15:14501:x1876532858581632:12345-192.168.201.30@tcp:36:lhsmtool_posix.0 Request processed in 958us (1241us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1789601630.453355:0:16328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 52 00010000:00010000:2.0:1789601630.457091:0:3303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad598 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.457115:0:3303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad598 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.457125:0:3303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad598 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.457155:0:3303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88e00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:2.0:1789601630.457162:0:3303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad598 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.457172:0:3303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad598 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.457193:0:3303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91edd80dd700) 00010000:00010000:2.0:1789601630.457196:0:3303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789601630.457202:0:3303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad598 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.457208:0:3303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88e00/0xf3d6e402158ad598 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601630.457312:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601630.457650:0:15140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858581760 00000100:00100000:2.0:1789601630.457663:0:15140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858581760 00000100:00100000:2.0:1789601630.457738:0:15140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:2.0:1789601630.457752:0:15140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+7:2359:x1876532858581760:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789601630.458250:0:15140:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789601630.458255:0:15140:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789601630 00002000:00010000:2.0:1789601630.458258:0:15140:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789601630 00002000:00010000:2.0:1789601630.458260:0:15140:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789601631 -> 1789601630 00002000:00010000:2.0:1789601630.458263:0:15140:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789601630.458385:0:15140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+8:2359:x1876532858581760:12345-192.168.201.30@tcp:2:lhsmtool_posix.0 Request processed in 635us (1077us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789601630.458395:0:15140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 17 00000100:00100000:1.0:1789601630.461470:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601630.461653:0:15141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858581888 00000100:00100000:2.0:1789601630.461684:0:15141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858581888 00000100:00100000:2.0:1789601630.461791:0:15141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:2.0:1789601630.461804:0:15141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+8:2359:x1876532858581888:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789601630.461925:0:15141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000408aba6e/0xf3d6e402158ad59f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.461949:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601630.461954:0:15141:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601630.461961:0:15141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000408aba6e/0xf3d6e402158ad59f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.462228:0:15141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000408aba6e/0xf3d6e402158ad59f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.462268:0:15141:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000408aba6e/0xf3d6e402158ad59f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.462278:0:15141:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000408aba6e/0xf3d6e402158ad59f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.462286:0:15141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000408aba6e/0xf3d6e402158ad59f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.462293:0:15141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d800 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601630.462299:0:15141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000408aba6e/0xf3d6e402158ad59f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.462324:0:15141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000408aba6e/0xf3d6e402158ad59f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.462344:0:15141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000408aba6e/0xf3d6e402158ad59f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.462353:0:15141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000408aba6e/0xf3d6e402158ad59f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601630.462515:0:15141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+8:2359:x1876532858581888:12345-192.168.201.30@tcp:1:lhsmtool_posix.0 Request processed in 712us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601630.462533:0:15141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:0.0:1789601630.467352:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601630.467472:0:14456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858582144 00000100:00100000:2.0:1789601630.467487:0:14456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858582144 00000100:00100000:2.0:1789601630.467662:0:14456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:2.0:1789601630.467677:0:14456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+14:14501:x1876532858582144:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789601630.467803:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ad5a6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.467828:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ad5a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.468892:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ad5a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.469359:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad5ad lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.469385:0:14456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ad57c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061552 expref: 15 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.469395:0:14456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad5ad lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.469447:0:14456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ad57c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061552 expref: 15 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.469467:0:14456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ad57c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061552 expref: 15 pid: 14456 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601630.469487:0:14456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14456:1876532880587648:192.168.201.30@tcp:104: 00000100:00100000:0.0:1789601630.470929:0:14456:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc50bb3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789601630.474371:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601630.475441:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601630.475662:0:14439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858582272 00000100:00100000:1.0:1789601630.475675:0:14439:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858582272 00010000:00010000:1.0:1789601630.475735:0:14439:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ad57c lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061552 expref: 16 pid: 14456 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601630.475790:0:14439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 13 00000100:00100000:1.0:1789601630.475803:0:14439:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+16:2357:x1876532858582272:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789601630.475822:0:14439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789601630.475830:0:14439:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ad57c lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061552 expref: 16 pid: 14456 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.475889:0:14439:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ad57c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061552 expref: 16 pid: 14456 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.475927:0:14439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91edd80dd700) 00010000:00010000:1.0:1789601630.475935:0:14439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad5ad lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.475948:0:14439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad5ad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.475956:0:14439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad5ad lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.476010:0:14439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789601630.476079:0:14439:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+16:2357:x1876532858582272:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 277us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789601630.476087:0:14439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 13 00010000:00010000:2.0:1789601630.477498:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8d600/0xf3d6e402158ad57c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061552 expref: 15 pid: 14456 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601630.477544:0:14456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14456:1876532880587648:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789601630.477578:0:14456:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad5ad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.477590:0:14456:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad5ad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.477596:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad5ad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789601630.478213:0:14456:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789601630.478428:0:14456:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789601630.478483:0:14456:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789601630.478663:0:14456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ecc2ed1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14456:1876532880587776:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789601630.478977:0:14456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601630.479087:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880587776 00000100:00100000:0.0:1789601630.479104:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880587776 00000100:00100000:0.0:1789601630.479181:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789601630.479192:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14456:x1876532880587776:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789601630.479296:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14456:x1876532880587776:12345-0@lo:1000:mdt00_002.0 Request processed in 105us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601630.479305:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789601630.479405:0:14456:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8dbfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789601630.479456:0:14456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ecc2ed1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14456:1876532880587776:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789601630.484359:0:14456:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1789601630.484458:0:14456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14456:1876532880587904:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789601630.484522:0:14456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789601630.484651:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880587904 00000100:00100000:0.0:1789601630.484667:0:14459:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880587904 00000100:00100000:3.0:1789601630.484783:0:14456:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc8b769c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789601630.484817:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789601630.484832:0:14459:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee00b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14456:x1876532880587904:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789601630.485196:0:14459:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee00b8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14456:x1876532880587904:12345-0@lo:1000:mdt00_002.0 Request processed in 367us (672us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789601630.485207:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789601630.485360:0:14456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14456:1876532880587904:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789601630.485507:0:14456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad5ad lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.485637:0:14456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad5ad lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.485644:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad5ad lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.485651:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c400 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601630.485655:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad5ad lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.485663:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad5ad lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.485678:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91edd80dd700) 00010000:00010000:3.0:1789601630.485681:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789601630.485686:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad5ad lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.485693:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8c400/0xf3d6e402158ad5ad lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.485726:0:14456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ad50c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.485732:0:14456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ad50c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.485738:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ad50c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.485753:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8de00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601630.485757:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ad50c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.485763:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ad50c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.485771:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91edd9174b00) 00010000:00010000:3.0:1789601630.485774:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789601630.485781:0:14456:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ad513 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061536 expref: 18 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.485793:0:14456:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ad513 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061536 expref: 18 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.485802:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ad513 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061536 expref: 18 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.485905:0:14456:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91ee00925000/0xf3d6e402158ad513 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061536 expref: 18 pid: 14456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601630.485920:0:14456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14456:1876532880588032:192.168.201.30@tcp:105: 00000100:00100000:3.0:1789601630.486113:0:14456:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edc50bb600 going to sleep for 11 seconds 00000100:00100000:1.0:1789601630.494985:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601630.495196:0:14456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14456:1876532880588032:192.168.201.30@tcp:105: 00010000:00010000:3.0:1789601630.495224:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ad50c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.495521:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8de00/0xf3d6e402158ad50c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.495572:0:14456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88400/0xf3d6e402158ad5b4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.495585:0:14456:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88400/0xf3d6e402158ad5b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.495597:0:14456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88400/0xf3d6e402158ad5b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.495608:0:14456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88400/0xf3d6e402158ad5b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.495614:0:14456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88400/0xf3d6e402158ad5b4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.495620:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88400/0xf3d6e402158ad5b4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.495626:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88400 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601630.495629:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88400/0xf3d6e402158ad5b4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.495637:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88400/0xf3d6e402158ad5b4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.495648:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91edd9174b00) 00010000:00010000:3.0:1789601630.495651:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789601630.495655:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88400/0xf3d6e402158ad5b4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.495668:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc3b88400/0xf3d6e402158ad5b4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.495678:0:14456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ad5a6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.495683:0:14456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ad5a6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.495689:0:14456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ad5a6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.495694:0:14456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8cc00 already unused, calling callback (ffffffffc221e4f0) 00010000:00010000:3.0:1789601630.495697:0:14456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ad5a6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.495703:0:14456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ad5a6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.495711:0:14456:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91edd9174b00) 00010000:00010000:3.0:1789601630.495713:0:14456:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789601630.495716:0:14456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ad5a6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.495722:0:14456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edd8d8cc00/0xf3d6e402158ad5a6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14456 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601630.496233:0:14456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+18:14501:x1876532858582144:12345-192.168.201.30@tcp:57:lhsmtool_posix.0 Request processed in 28555us (28893us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1789601630.496235:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858582400 00000100:00100000:3.0:1789601630.496253:0:14456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 53 00000100:00100000:0.0:1789601630.496254:0:14458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858582400 00000020:00080000:3.0:1789601630.496286:0:14456:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789601630.496345:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 10 00000100:00100000:0.0:1789601630.496373:0:14458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf9938c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+18:14500:x1876532858582400:12345-192.168.201.30@tcp:49:dd.0 00000100:00100000:0.0:1789601630.496530:0:14458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf9938c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+18:14500:x1876532858582400:12345-192.168.201.30@tcp:49:dd.0 Request processed in 161us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601630.496538:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 10 00000040:00080000:0.0:1789601630.500187:0:14486:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789601630.500202:0:14486:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789601630.500249:0:14486:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789601630.500257:0:14486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789601630.506244:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601630.506424:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858582656 00000100:00100000:0.0:1789601630.506434:0:14458:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858582656 00000100:00100000:0.0:1789601630.506499:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 11 00000100:00100000:0.0:1789601630.506510:0:14458:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+18:14501:x1876532858582656:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789601630.508939:0:14458:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789601630.509122:0:14458:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1789601630.509377:0:14458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030c00/0xf3d6e402158ad5bb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.509634:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030c00/0xf3d6e402158ad5bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.509651:0:14458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030c00/0xf3d6e402158ad5bb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.509660:0:14458:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030c00/0xf3d6e402158ad5bb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.509667:0:14458:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030c00/0xf3d6e402158ad5bb lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.509673:0:14458:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030c00/0xf3d6e402158ad5bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.509698:0:14458:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789601630.509909:0:14458:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+20:14501:x1876532858582656:12345-192.168.201.30@tcp:35:lhsmtool_posix.0 Request processed in 3397us (3670us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1789601630.509920:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 11 00000020:00080000:1.0:1789601630.509936:0:14458:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789601630.510037:0:14443:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789601630.510045:0:14443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030c00/0xf3d6e402158ad5bb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.510053:0:14443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030c00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601630.510058:0:14443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030c00/0xf3d6e402158ad5bb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.510068:0:14443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030c00/0xf3d6e402158ad5bb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.510080:0:14443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91edd80dd700) 00010000:00010000:2.0:1789601630.510083:0:14443:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789601630.510087:0:14443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030c00/0xf3d6e402158ad5bb lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.510094:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91edc0030c00/0xf3d6e402158ad5bb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14458 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.510108:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601630.510110:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789601630.510112:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789601630.698086:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601630.698121:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601630.698212:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601630.699284:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858582912 00000100:00100000:2.0:1789601630.699295:0:15146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858582912 00000100:00100000:2.0:1789601630.699348:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858583040 00000100:00100000:2.0:1789601630.699352:0:15146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858583040 00000100:00100000:2.0:1789601630.699368:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858582784 00000100:00100000:2.0:1789601630.699370:0:15146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858582784 00000100:00100000:2.0:1789601630.699478:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:2.0:1789601630.699489:0:15146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+10:2359:x1876532858582912:12345-192.168.201.30@tcp:4:dd.0 00010000:00010000:2.0:1789601630.699534:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e87b5ce2/0xf3d6e402158ad5c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.699619:0:15146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad591 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061560 expref: 10 pid: 15142 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.699630:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601630.699636:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601630.699641:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e87b5ce2/0xf3d6e402158ad5c2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.699681:0:15146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad591 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061560 expref: 10 pid: 15142 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.699698:0:15146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad591 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061560 expref: 10 pid: 15142 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601630.699713:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee002ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:15146:1876532880588160:192.168.201.30@tcp:104: 00000100:00100000:2.0:1789601630.700217:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff91edf9d66a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789601630.711028:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:3.0:1789601630.711347:0:14441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858583168 00000100:00100000:3.0:1789601630.711357:0:14441:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858583168 00010000:00010000:3.0:1789601630.711408:0:14441:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad591 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061560 expref: 11 pid: 15142 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601630.711451:0:14441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 14 00000100:00100000:3.0:1789601630.711461:0:14441:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+11:2357:x1876532858583168:12345-192.168.201.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789601630.711476:0:14441:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789601630.711498:0:14441:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad591 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061560 expref: 11 pid: 15142 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.711521:0:14441:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad591 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061560 expref: 11 pid: 15142 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.711560:0:14441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601630.711565:0:14441:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601630.711572:0:14441:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e87b5ce2/0xf3d6e402158ad5c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.711589:0:14441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e87b5ce2/0xf3d6e402158ad5c2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.711611:0:14441:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789601630.712301:0:14441:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9e82277c-40aa-4559-8a65-5f21a02d7d72+11:2357:x1876532858583168:12345-192.168.201.30@tcp:103:ldlm_bl.0 Request processed in 838us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601630.712311:0:14441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 14 00010000:00010000:2.0:1789601630.713002:0:15146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad591 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.30@tcp remote: 0xfba567d4f5061560 expref: 10 pid: 15142 timeout: 600 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601630.713021:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee002ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0000_UUID:15146:1876532880588160:192.168.201.30@tcp:104: 00010000:00010000:2.0:1789601630.713054:0:15146:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e87b5ce2/0xf3d6e402158ad5c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.713067:0:15146:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e87b5ce2/0xf3d6e402158ad5c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601630.713085:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e87b5ce2/0xf3d6e402158ad5c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601630.829419:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:3.0:1789601630.829437:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:0.0:1789601630.829598:0:15146:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:0.0:1789601630.829602:0:15146:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789601630 -> 1789601631 00002000:00010000:0.0:1789601630.829605:0:15146:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:0.0:1789601630.829619:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e87b5ce2/0xf3d6e402158ad5c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.829631:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e87b5ce2/0xf3d6e402158ad5c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.829640:0:15146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e87b5ce2/0xf3d6e402158ad5c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.829661:0:15146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8d600 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601630.829666:0:15146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e87b5ce2/0xf3d6e402158ad5c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.829675:0:15146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e87b5ce2/0xf3d6e402158ad5c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.829693:0:15146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e87b5ce2/0xf3d6e402158ad5c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.829700:0:15146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e87b5ce2/0xf3d6e402158ad5c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601630.833649:0:15146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+7:2359:x1876532858582912:12345-192.168.201.30@tcp:4:dd.0 Request processed in 134149us (135571us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789601630.833672:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 0 00000100:00100000:0.0:1789601630.833718:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:0.0:1789601630.833733:0:15146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:2359:x1876532858583040:12345-192.168.201.30@tcp:4:dd.0 00002000:00010000:0.0:1789601630.833790:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6aab275f, atime: 0x6aab275e, ctime: 0x0, blocks: 0x807 00010000:00010000:0.0:1789601630.833886:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad5c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.833904:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=500s v=(0 0) 00010000:00010000:0.0:1789601630.833908:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601630.833929:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad5c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.833945:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad5c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789601630.959252:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:1.0:1789601630.959367:0:15146:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1789601630.959373:0:15146:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:1.0:1789601630.959393:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad5c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.959408:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad5c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.959417:0:15146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad5c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.959425:0:15146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00924800 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:1.0:1789601630.959430:0:15146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad5c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.959440:0:15146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad5c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.959465:0:15146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad5c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.959472:0:15146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f049d2f/0xf3d6e402158ad5c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601630.959756:0:15146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+6:2359:x1876532858583040:12345-192.168.201.30@tcp:4:dd.0 Request processed in 126021us (261625us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789601630.959768:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 1 00000100:00100000:1.0:1789601630.959832:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:1.0:1789601630.960591:0:15146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edf8b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+5:2359:x1876532858582784:12345-192.168.201.30@tcp:4:dd.0 00002000:00010000:1.0:1789601630.960731:0:15146:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aab275f, atime: 0x6aab275e, ctime: 0x0, blocks: 0x1007 00010000:00010000:1.0:1789601630.960741:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad5d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.960756:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=500s v=(0 0) 00010000:00010000:1.0:1789601630.960761:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601630.960768:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad5d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601630.960783:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad5d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601630.976238:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601630.976326:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601630.976391:0:15145:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1789601630.976459:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601630.976522:0:15147:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789601630.976676:0:15145:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1789601630.977116:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858583296 00000100:00100000:3.0:1789601630.977129:0:15145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858583296 00000100:00100000:3.0:1789601630.977204:0:15145:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789601630.977211:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858583552 00000100:00100000:3.0:1789601630.977214:0:15145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858583552 00000100:00100000:0.0:1789601630.977727:0:16688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:0.0:1789601630.977741:0:16688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+8:2356:x1876532858583296:12345-192.168.201.30@tcp:4:dd.0 00010000:00010000:0.0:1789601630.977802:0:16688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad5d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.977825:0:16688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789601630.977830:0:16688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789601630.977883:0:16688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad5d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601630.977905:0:16688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad5d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789601630.981524:0:15145:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1789601630.981549:0:15145:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1789601630.981767:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858583680 00000100:00100000:3.0:1789601630.981781:0:15145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858583680 00000100:00100000:2.0:1789601630.982115:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601630.982170:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601630.982191:0:15147:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789601630.982199:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858583808 00000100:00100000:2.0:1789601630.982203:0:15147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858583808 00000100:00100000:2.0:1789601630.982228:0:15147:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789601630.982233:0:15147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858583424 00000100:00100000:2.0:1789601630.982236:0:15147:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858583424 00000100:00100000:3.0:1789601630.982535:0:16689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:3.0:1789601630.982556:0:16689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9e82277c-40aa-4559-8a65-5f21a02d7d72+11:2357:x1876532858583552:12345-192.168.201.30@tcp:4:dd.0 00010000:00010000:3.0:1789601630.982617:0:16689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cea1ae1/0xf3d6e402158ad5de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.982642:0:16689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601630.982649:0:16689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789601630.982656:0:16689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cea1ae1/0xf3d6e402158ad5de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789601630.982673:0:16689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cea1ae1/0xf3d6e402158ad5de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789601631.047478:0:15146:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:0.0:1789601631.047493:0:15146:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1789601631.047514:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad5d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.047531:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad5d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.047570:0:15146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad5d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.047577:0:15146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0030c00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601631.047583:0:15146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad5d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.047593:0:15146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad5d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.047619:0:15146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad5d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.047628:0:15146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d49bbbee/0xf3d6e402158ad5d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601631.047745:0:15146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edf8b18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+16:2359:x1876532858582784:12345-192.168.201.30@tcp:4:dd.0 Request processed in 87839us (349525us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789601631.047758:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 2 00000100:00100000:0.0:1789601631.047799:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 5 00000100:00100000:1.0:1789601631.048252:0:15146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+15:2357:x1876532858583680:12345-192.168.201.30@tcp:4:dd.0 00000001:00080000:3.0:1789601631.048299:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00010000:00010000:1.0:1789601631.048301:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad5e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601631.048319:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601631.048324:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789601631.048333:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad5e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789601631.048349:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad5e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789601631.106299:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:2.0:1789601631.107673:0:16689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:2.0:1789601631.107699:0:16689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cea1ae1/0xf3d6e402158ad5de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601631.107715:0:16689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cea1ae1/0xf3d6e402158ad5de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601631.107726:0:16689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cea1ae1/0xf3d6e402158ad5de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601631.107747:0:16689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc3b88400 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601631.107753:0:16689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cea1ae1/0xf3d6e402158ad5de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601631.107764:0:16689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cea1ae1/0xf3d6e402158ad5de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601631.107788:0:16689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cea1ae1/0xf3d6e402158ad5de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601631.107796:0:16689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cea1ae1/0xf3d6e402158ad5de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601631.107979:0:16689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9e82277c-40aa-4559-8a65-5f21a02d7d72+13:2357:x1876532858583552:12345-192.168.201.30@tcp:4:dd.0 Request processed in 125421us (131643us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789601631.107993:0:16689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 4 00000100:00100000:2.0:1789601631.108038:0:16689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 6 00000100:00100000:2.0:1789601631.108066:0:16689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9e82277c-40aa-4559-8a65-5f21a02d7d72+12:2359:x1876532858583808:12345-192.168.201.30@tcp:4:dd.0 00010000:00010000:2.0:1789601631.108109:0:16689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158ad5ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601631.108124:0:16689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601631.108129:0:16689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601631.108136:0:16689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158ad5ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601631.108162:0:16689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158ad5ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789601631.146605:0:16688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:0.0:1789601631.146619:0:16688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:0.0:1789601631.146639:0:16688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad5d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.146656:0:16688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad5d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.146685:0:16688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad5d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.146697:0:16688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91ee00925e00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601631.146704:0:16688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad5d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.146715:0:16688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad5d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.146743:0:16688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad5d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.146752:0:16688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000093100ef/0xf3d6e402158ad5d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601631.150639:0:16688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+16:2356:x1876532858583296:12345-192.168.201.30@tcp:4:dd.0 Request processed in 172884us (174398us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1789601631.150659:0:16688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 3 00000100:00100000:2.0:1789601631.150713:0:16688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 7 00000100:00100000:2.0:1789601631.150729:0:16688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ee002ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+15:2356:x1876532858583424:12345-192.168.201.30@tcp:4:dd.0 00010000:00010000:2.0:1789601631.150785:0:16688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a82f909/0xf3d6e402158ad5f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601631.150808:0:16688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601631.150813:0:16688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789601631.150822:0:16688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a82f909/0xf3d6e402158ad5f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789601631.155085:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00010000:00010000:2.0:1789601631.156654:0:16688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a82f909/0xf3d6e402158ad5f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789601631.177425:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789601631.177453:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91ee00b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880588288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789601631.177543:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789601631.177713:0:15144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532880588288 00000100:00100000:3.0:1789601631.177735:0:15144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532880588288 00000100:00100000:3.0:1789601631.177801:0:15144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789601631.177814:0:15144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880588288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789601631.177902:0:15144:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 69795840 pending 5111808 free 3859808256 avail 3852468224 00000100:00100000:3.0:1789601631.177969:0:15144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1876532880588288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601631.177977:0:15144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789601631.178129:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1789601631.178136:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91edf8b19880, transno 8589934595 00000004:00080000:1.0:1789601631.178161:0:3318:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1789601631.178197:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91ee00b8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3318:1876532880588288:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1789601631.211062:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:0.0:1789601631.211436:0:16689:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:0.0:1789601631.211455:0:16689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158ad5ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.211467:0:16689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158ad5ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.211474:0:16689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158ad5ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.211494:0:16689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8dc00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601631.211498:0:16689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158ad5ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.211505:0:16689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158ad5ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.211525:0:16689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158ad5ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.211530:0:16689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002801fd94/0xf3d6e402158ad5ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601631.211660:0:16689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9e82277c-40aa-4559-8a65-5f21a02d7d72+11:2359:x1876532858583808:12345-192.168.201.30@tcp:4:dd.0 Request processed in 103598us (229546us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789601631.211669:0:16689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 6 00010000:00010000:2.0:1789601631.212126:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad5e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601631.212138:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad5e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601631.212162:0:15146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad5e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601631.212169:0:15146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edc0031e00 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:2.0:1789601631.212172:0:15146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad5e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601631.212180:0:15146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad5e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601631.212191:0:15146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad5e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789601631.212198:0:15146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000803a8b26/0xf3d6e402158ad5e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789601631.212257:0:15146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9e82277c-40aa-4559-8a65-5f21a02d7d72+9:2357:x1876532858583680:12345-192.168.201.30@tcp:4:dd.0 Request processed in 164449us (235797us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789601631.212264:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 5 00000001:00080000:1.0:1789601631.273167:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:0.0:1789601631.273300:0:16688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1789601631.273321:0:16688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a82f909/0xf3d6e402158ad5f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.273338:0:16688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a82f909/0xf3d6e402158ad5f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.273347:0:16688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a82f909/0xf3d6e402158ad5f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.273378:0:16688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91edd8d8c800 already unused, calling callback (ffffffffc17c18b0) 00010000:00010000:0.0:1789601631.273384:0:16688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a82f909/0xf3d6e402158ad5f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.273393:0:16688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a82f909/0xf3d6e402158ad5f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.273419:0:16688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a82f909/0xf3d6e402158ad5f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789601631.273428:0:16688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a82f909/0xf3d6e402158ad5f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789601631.273564:0:16688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ee002ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+5:2356:x1876532858583424:12345-192.168.201.30@tcp:4:dd.0 Request processed in 122835us (291386us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789601631.273575:0:16688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 7 00010000:00010000:3.0:1789601631.497345:0:15467:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789601632.522404:0:14442:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789601632.586652:0:14486:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789601632.586660:0:14486:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789601632.586698:0:14486:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789601632.586704:0:14486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:02000400:0.0:1789601632.768064:0:16726:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1789601633.242021:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601633.242071:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601633.242101:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601633.242129:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601633.242151:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:1.0:1789601633.242186:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:2.0:1789601633.242251:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858584448 00000100:00100000:2.0:1789601633.242262:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858584448 00000100:00100000:2.0:1789601633.242321:0:14454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858584064 00000100:00100000:2.0:1789601633.242324:0:14454:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858584064 00000100:00100000:2.0:1789601633.242346:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:2.0:1789601633.242356:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6328b6e-fdda-4b75-9930-1671a349afd2+6:2358:x1876532858584448:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601633.242460:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6328b6e-fdda-4b75-9930-1671a349afd2+6:2358:x1876532858584448:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 105us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601633.242467:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 31 00000100:00100000:2.0:1789601633.242486:0:14454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:2.0:1789601633.242493:0:14454:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+20:2358:x1876532858584064:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:2.0:1789601633.242536:0:14454:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9e82277c-40aa-4559-8a65-5f21a02d7d72+20:2358:x1876532858584064:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 43us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789601633.242541:0:14454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 32 00000100:00100000:3.0:1789601633.242617:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858583936 00000100:00100000:3.0:1789601633.242622:0:14448:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858583936 00000100:00100000:3.0:1789601633.242652:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00100000:3.0:1789601633.242659:0:14448:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91ede9bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+13:2358:x1876532858583936:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:3.0:1789601633.242686:0:14448:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91ede9bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:15f5cf11-52eb-460f-b02c-b9251b294d39+13:2358:x1876532858583936:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 28us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789601633.242693:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 124 00000100:00080000:3.0:1789601633.242745:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789601633.243004:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.30@tcp (source: 12345-192.168.201.30@tcp) 00000100:00100000:0.0:1789601633.247665:0:16106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858584192 00000100:00100000:0.0:1789601633.247690:0:16106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858584192 00000100:00100000:0.0:1789601633.247897:0:16106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858584704 00000100:00100000:0.0:1789601633.247902:0:16106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858584704 00000100:00100000:0.0:1789601633.248650:0:16106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858584320 00000100:00100000:0.0:1789601633.248659:0:16106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858584320 00000100:00100000:0.0:1789601633.248695:0:16106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:0.0:1789601633.248709:0:16106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+5:2358:x1876532858584192:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601633.249357:0:16106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+5:2358:x1876532858584192:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 645us (7279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601633.249368:0:16106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 18 00000100:00100000:0.0:1789601633.249398:0:16106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:0.0:1789601633.249407:0:16106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6328b6e-fdda-4b75-9930-1671a349afd2+5:2358:x1876532858584704:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601633.250660:0:16106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6328b6e-fdda-4b75-9930-1671a349afd2+5:2358:x1876532858584704:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 35us (7310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601633.250683:0:16106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 19 00000100:00100000:0.0:1789601633.250722:0:16106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00100000:0.0:1789601633.250737:0:16106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+5:2358:x1876532858584320:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601633.250819:0:16106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9e82277c-40aa-4559-8a65-5f21a02d7d72+5:2358:x1876532858584320:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 89us (8638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601633.250825:0:16106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 20 00000100:00080000:0.0:1789601633.250871:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789601633.250878:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789601633.259715:0:16106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876532858584576 00000100:00100000:0.0:1789601633.259733:0:16106:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876532858584576 00000100:00100000:0.0:1789601633.260195:0:16106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00100000:0.0:1789601633.260206:0:16106:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91edfff65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6328b6e-fdda-4b75-9930-1671a349afd2+5:2358:x1876532858584576:12345-192.168.201.30@tcp:400:kworker.0 00000100:00100000:0.0:1789601633.260295:0:16106:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91edfff65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b6328b6e-fdda-4b75-9930-1671a349afd2+5:2358:x1876532858584576:12345-192.168.201.30@tcp:400:kworker.0 Request processed in 91us (17291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789601633.260303:0:16106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.30@tcp, seq: 21 00000100:00080000:3.0:1789601633.260673:0:14450:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789601633.545057:0:14443:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30066 lines, 30066 kept, 0 dropped, 0 bad.